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PLURALITY OF PICTURE APPEARANCE CHOICES FROM A 
COLOR PHOTOGRAPHIC RECORDING MATERIAL 

INTENDED FOR SCANNING 
CROSS REFERENCE TO RELATED APPLICATIONS 

This is a continuation-in-part of U.S. Serial No. 09/592,816, filed 

June 13,2000. 

FIELD OF THE INVENTION 

The present invention relates to the field of photography; more 
particularly, it relates to a photofinishing system as well as to an electronic image 
processing and manipulation arrangement, which includes digital image 
processing. The method is especially suitable for providing a selection of scene 
reproductions with more than one particular characteristic appearance or "look", 
where the image reproduction selection is achieved by the exposure, development, 
and scanning and image processing of a color photographic recording material 

intended for scanning. 

BACKGROUND OF THE INVENTION 

Color photographic systems known in the art capture images of 
scenes on light-sensitive silver halide media or electronic devices, recording the 
exposing light in analog or digital form, respectively. Following processing, they 
provide printed hard copy or soft copy output as a visual reproduction of the 
recorded scene. For example, scene images can be captured on color negative 
film and then reproduced after chemical development by optical printing, or 
scanning and electronic writing on photographic paper. Scene images can also be 
captured on reversal photographic materials, such as slide transparencies, and then 
be viewed directly by projection or back-illumination, or even be printed onto 
silver halide photographic paper. In other cases, color images can be captured by 
electronic devices, such as video cameras or digital still cameras, and viewed on 
monitors or printed using dye sublimation thermal printers. The systems 
mentioned above are just some examples of color image recording systems. In 
each case, these systems produce different appearance characteristics in the color 
reproduction. 



These differing reproduction appearance characteristics are a result 
of a number of different factors. The final appearance relates to the properties of 
the scene-recording element (color recording accuracy and signal-to-noise), the 
system image processing (rendering of hue, colorfulness, lightness, noise, 
5 sharpness, and tone scale), and the display form (print, slide or soft copy) with its 
individual color reproduction gamut, as well as the viewing conditions and the 
state of adaptation of the viewer. In a traditional photographic system which 
includes a color negative film and photo finishing involving film development and 
tail-end processing — and optical printing onto color paper with its subsequent 

10 development and tail-end processing — the film tends to dominate the imaging 

chain properties. Its color recording accuracy, graininess, sharpness enhancement, 
contrast or gamma, and particularly its chemical interlayer interimage effects, 
which provide full system color correction and sharpness enhancement, tend to 
produce a recognizable, characteristic appearance of the final reflection print 

15 across all subject matter. The sustained improvement of these individual 

properties and their aggregate performance has been the basis for marketplace 
competition in film for decades. Furthermore, the overall limitations of a pure 
chemical imaging system, particularly around color and tone reproduction, have 
forced the specialization of films for different applications and induced the 

20 marketplace to segment the product category into different lines. Consumers 
typically select film giving higher print contrast and colorfulness for general- 
purpose photography, whereas advanced amateurs often prefer films producing 
more accurate color reproduction with lower contrast. Professional photographers 
select films for portraiture producing low print contrast and excellent flesh hues, 

25 with lower sharpness for a softer, more pleasing look. Should a photographer 

have mixed subject matter (e.g., portraits, scenic landscapes, and "candid or grab- 
shots" of people), the film properties will compromise the print reproduction of at 
least some of the images relative to the selection of a specialized film. This 
compromise is so significant that Advanced Photo System™ camera designers 

30 have made film mid-roll interrupt a premium camera feature so the photographers 
can remove a partially used film roll and replace it with another better suited to 
the photographer's changing artistic preference or scene content requirements. 
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The astute photographer knows to select a particular film to achieve a desired 
characteristic print appearance, or "look". 

Electronic image processing following film scanning or digital still 
camera capture, new silver halide paper writing devices (e.g., laser writers), and 
5 new print methods and media (e.g., Inkjet printers and inks) are revolutionizing 
color reproduction by re-defining print color and tone rendering. The rigid 
limitations imposed by a pure chemical system of color correction and image 
structure management with a silver halide print of the prior art have been 
removed, and many system tone scales, colorfulness levels, hue and lightness 

10 renditions, and sharpness levels can be provided using an electronic signal 

processing chain. Thus it is possible to manipulate the appearance characteristics 
in an automated photofinishing process by applying mathematical algorithms to 
the individual image pixel data to provide a scene reproduction having a desired 
balance of contrast, color saturation and pleasing skin tones as determined by a 

15 manufacturer or photofinisher. See for example U.S. Patent No, 5,528,339 to 
Buhr et al. 

Digital minilab photofinishing systems are beginning to 
supplement optical printing minilabs in the commercial trade, in part to provide 
printing services to digital still camera photographers as well as network services 

20 to current camera films designed for optical printing. The NORITSU QSS-271 1 
DLS System uses KODAK DLS Software in order to provide silver halide prints 
enhanced by electronic image processing that have adjusted contrast, color 
balance corrected for indoor lighting, and increased print sharpness. It also 
provides special effects printing, including black-&-white or sepia-toned 

25 renditions of color input (e.g., from color recording films or digital cameras) and 
exaggerated, high-color printing. 

The success of such digital image processing to provide one or 
more pleasing print appearances still depends heavily on the quality of the image 
capture medium or device. Current photographic image capture films were 

30 designed for direct viewing (color reversal) or optical printing (color negative) 
and are sub-optimal for digitization compared with films designed for scanning 
and electronic signal processing. U.S, Patent No. 5,582,961 to Giorgianni et al. 
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describes a color reversal photographic recording material providing 
colorimetrically accurate scene capture that is intended for scanning and not for 
direct viewing or optical printing onto silver halide color paper (i.e., a scan film or 
scan-only film). A viewable image can be obtained by scanning a color negative 
5 film that lacks colored masking couplers, as in U.S. Patent No. 5,698,379 to 
Bohan et al. or in U.S. Patent No. 6,021,277 to Sowinski et al., for example. 
Having been so designed without inherent system color correction properties like 
optical print films or slide films, a scan film has no acceptable characteristic 
image reproduction appearance associated with it, and one must be provided by 

1 0 the selection of digital image processing parameters. Providing more than one 

desirable print appearance from the image data produced from the scan film is not 
mentioned in U.S. Patent Nos. 5,587,961, 5,698,379 and 6,021,277. 

It would be highly desirable to provide photographers with greater 
control and selection over the look of their pictures derived from a single taking 

15 medium, and to enable the convenience of exercising this control after the 

exposure stage of photography, contrary to the present situation involving silver 
halide color films intended for optical printing or direct viewing. 

SUMMARY OF THE INVENTION 
The above need is met by a first aspect of the present invention, by 

20 providing a method of photofinishing including the steps of offering a plurality of 
possible image looks and representing the selections on a display medium; 
receiving image-bearing electronic signals derived from a color photographic 
recording material intended for scanning from a sender; selecting one or more of 
the possible looks to apply to image-bearing electronic signals derived from a 

25 color photographic recording material intended for scanning; processing said 
image-bearing electronic signals to provide a processed image having the 
properties of the selected look; and transferring the processed image to an 
intended recipient. 

A second aspect of the present invention is to provide a method of 

30 photofinishing including the steps of offering a plurality of possible image looks 
and representing the selections on a display medium; receiving an exposed color 
photographic recording material intended for scanning; processing the exposed 



color photographic recording material to produce an image suitable for scanning; 
scanning the image to produce image-bearing electronic signals; processing the 
image-bearing electronic signals to apply a selected look and; providing a 
processed image with the appearance characteristics of the selected look to an 
5 intended recipient. 

The present invention has an advantage of providing a 
photographer with the choice of differing image looks or appearance 
characteristics that can be selected at any point in the photographic scene capture 
and image reproduction process, and which can be applied to the image at the time 

10 of photofinishing. The method allows for the use of a single photographic 

recording material intended for scanning to produce a selection of different image 
appearances, which provides convenience and simplicity over selecting from a 
plurality of films intended for optical printing or direct viewing at the time of 
photographic capture. These differing looks are produced from an origination 

15 image file resulting from scanning a photographic recording material that is 

intended for scanning, providing enormous flexibility in the processes of image 
look selection and photofinishing. According to a preferred embodiment, the 
photofinishing method can be offered as an interactive service with an Internet 
World Wide Web site. The photofinisher supplies the customer with a scan film 

20 and a processing mailer. The examples of looks are displayed on the Web site and 
the customer selects one or more of the looks to be applied to his images. 

The present invention therefore relates to a photofinishing method 
which comprises offering a plurality of available image looks to a customer in a 
manner which permits the customer to select at least one image look for 

25 association with at least one image captured by the customer on scan-only 
photographic material; converting the at least one image to an image-bearing 
electronic signal representative of the at least one image; applying the selected 
look to the image-bearing electronic signal; processing the image-bearing 
electronic signal to provide a processed image having properties of the selected 

30 image look; and transferring the processed image to at least one of a customer or 
an intended recipient. 
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The present invention further relates to a photofinishing method 
which comprises offering a plurality of possible image looks and representing the 
image looks on a display medium for viewing and selection by a customer; 
receiving an exposed color photographic recording material intended for scanning 
5 from the customer; processing the exposed color photographic recording material 
to produce an image suitable for scanning; scanning the image to produce image- 
bearing electronic signals; processing the image-bearing electronic signals to 
apply a selected look from the plurality of possible image looks; and providing a 
processed image with an appearance characteristic of the selected image look to at 
10 least one of the customer or an intended recipient. 

The present invention further relates to a photofinishing method 
n which comprises offering a plurality of available image looks to a customer in a 

j u manner which permits the customer to select at least one image look which is to 

£ be applied to an image-bearing electronic signal representative of a captured 

J 2 15 image; receiving the image-bearing electronic signal and information 

; 0 representative of the selected image look; processing the image-bearing electronic 

, signal to provide a processed image having properties of the selected image look; 

L~ and transferring the processed image to at least one of the customer or an intended 

y recipient. 

^ 20 The present invention further relates to an image processing 

arrangement which comprises an input section adapted to receive a digital image; 
and a processing section including a display for displaying a plurality of available 
image looks. The processing section is adapted to permit a user to select at least 
one look from the available looks for association with the digital image, and to 
25 process the digital image to provide for a processed image having properties of the 
selected look. 

The present invention further relates to a computer program 
product, comprising a computer readable storage medium having a computer 
program stored thereon, which when loaded into the computer, causes the 
30 computer to perform the steps of: offer a plurality of available image looks to a 

customer in a manner which permits the customer to select at least one image look 
which is to be applied to an image-bearing electronic signal representative of a 




captured image; transfer the image-bearing electronic signal and information 
representative of the selected image look to a photofmishing service provider; 
process the image-bearing electronic signal to provide a processed image having 
properties of the selected image look; and transfer the processed image to at least 
5 one of the customer or an intended recipient. 

The present invention further relates to a photofinishing method 
based on an interactive photofinishing service ordering session between a 
photofinishing service provider and a customer. The method comprises checking 
for a stored customer profile for the customer based on at least a customer 

10 identification of the customer, with the customer profile including information 
representative of previously selected preferred image looks for the customer. If 
the customer has a stored customer profile, the method comprises offering a 
plurality of possible image looks to the customer in a manner which permits the 
customer to select a preferred image look which is to be applied to an image 

15 bearing electronic signal representative of a captured image, with at least one of 
the offered possible image looks being a previously selected preferred image look 
from the stored customer profile; and updating the stored customer profile based 
on the selected preferred image look. If the customer does not have a stored 
customer profile, the method comprises offering a plurality of possible image 

20 looks to the customer in a manner which permits the customer to select at least 
one image look which is to be applied to an image bearing electronic signal 
representative of a captured image; and creating a new customer profile based on 
the selected image look. 

The present invention further relates to a computer program 

25 product which comprises a computer readable storage medium having a computer 
program stored thereon, which when loaded into the computer, causes the 
computer to perform the steps of offering photofinishing services based on an 
interactive photofinishing service ordering session between a photofinishing 
service provider and a customer which comprises checking a server for a stored 

30 customer profile for the customer based on at least a customer identification of the 
customer. The customer profile includes information representative of previously 
selected preferred image looks for the customer, wherein if the customer has a 




stored customer profile, the method comprises offering a plurality of possible 
image looks to the customer in a manner which permits the customer to select a 
preferred image look which is to be applied to an image-bearing electronic signal 
representative of a captured image, with at least one of the offered possible image 
5 looks being a previously selected preferred image look from the stored customer 
profile; and updating the stored customer profile based on the selected preferred 
image look. If the customer does not have a stored customer profile, the method 
comprises offering a plurality of possible image looks to the customer in a manner 
which permits the customer to select at least one image look which is to be 

10 applied to an image bearing electronic signal representative of a captured image; 
and creating a new customer profile based on the selected image look. 

The present invention further relates to a photofinishing method 
based on an interactive photofinishing service ordering session between a 
photofinishing service provider and a customer, wherein the customer accesses a 

1 5 monitor during the ordering session. The method comprises determining monitor 
settings of the monitor accessed by the customer; comparing the determined 
monitor settings to optimum monitor settings that provide preferred calibration 
results; providing color calibration information to the customer based on the 
comparing step; and checking for a stored customer profile for the customer based 

20 on at least a customer identification of the customer. The customer profile 

includes information representative of preferred monitor settings for the customer. 

The present invention further relates to a computer program 
product which comprises a computer readable storage medium having a computer 
program stored thereon, which when loaded into the computer, causes the 

25 computer to perform the steps of: offer photofinishing services based on an 
interactive photofinishing service ordering session between a photofinishing 
service provider and a customer, wherein the customer accesses a monitor during 
the interactive ordering session; determine monitor settings of the monitor 
accessed by the customer; compare the determined monitor settings to optimum 

30 monitor settings that provide preferred calibration results; provide color 

calibration information to the customer based on the comparing step; and check 
for a stored customer profile for the customer based on at least a customer 



identification of the customer. The customer profile includes information 
representative of preferred monitor settings for the customer. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing a photofinishing system 
5 according to the present invention; 

Fig. 2 A is the front side of a film processing envelope for 
photofinishing services that provide selectable image looks; 

Fig. 2B is the backside of a film processing envelope for 
photofinishing services, which displays a catalog of the variable image 
10 reproductions; 

Fig. 3 is a computer monitor display of an Internet Web page 
relating to a method of interactive picture look selection; 

Fig. 4A is a computer monitor display of an Internet Web page 
showing the examples of image looks provided according to the present invention; 
15 Fig. 4B. is a computer monitor display of an Internet Web page 

showing examples of additional information that can be associated with and 
accompany the image looks provided according to the present invention; 

Fig. 5 is a block diagram showing a photofinishing system capable 
of accepting and processing images according to the present invention; 
20 Fig. 6 is a block diagram showing a networked computer system 

capable of accepting and sending image data according to the present invention; 

Fig. 7 is a block diagram showing a preferred method of electronic 
signal processing of input image-bearing signals from scanning to form output 
image-bearing signals for printing that have been modified in accord with a 
25 selected appearance; 

Fig. 8 is a block diagram showing further features of a 
photofinishing system according to the present invention; 

Fig. 9 is a computer monitor display of a customer identification 
and log-on page; 

30 Fig. 10 is a computer monitor display of an Internet Web page 

showing the selection of image looks provided according to the present invention; 
and 



# -10- ^ 



Fig. 1 1 is a block diagram which illustrates the building of a 
customer profile for personalized image look selection in accordance with a 
further feature of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
5 Figure 1 is a block diagram illustrating an embodiment of the 

present invention. In step 101, a photofinisher provides a catalog of available 
image looks and options for the photofinishing service. An image "look" can be 
defined by characterizing the appearance of a reproduction relative to the 
appearance of the original scene. Individuals differ in their preference for 

1 0 appearance characteristics of image reproductions. An original scene can be 

reproduced with accurate hues, or with hues shifted in color space according to an 
individual or a general population preference. An original scene can be 
reproduced with varying levels of colorfulness, i.e., entirely without color as in 
black-and-white, with accurate colorfulness, or with increased colorfulness; in 

1 5 addition, the colorfulness of particular colors within the scene may desirably be 
manipulated relative to one another. An original scene can be reproduced with 
varying levels of lightness, e.g., contrast, and with rendering tone scales that vary 
with overall light levels; tone scale selection can be used to mitigate the visual 
effect of harsh scene lighting (e.g., lower contrast) or flat scene lighting (e.g., 

20 higher contrast). Furthermore, spatial image manipulations relating to image 
noise alteration (e.g., noise reduction or graininess smoothing) and detail or 
sharpness alteration (e.g., unsharp masking to increases low frequency 
information) can also affect the appearance of and desirability of a scene 
reproduction. 

25 Within the context of the present invention, the term "looks" 

relates to specific combinations of color hue reproduction, colorfulness level and 
tonal rendering, and spatial manipulations, which provide pleasing scene 
reproductions to one or more individuals. It will be appreciated that a pleasing 
scene reproduction to a particular individual or group of individuals does not 

30 necessarily provide for superior scene reproduction from a technical basis. For 
example, a grotesque or dark, Gothic reproduction of a scene which may be 
pleasing to a particular individual, but not necessarily an accurate or broadly 



preferred rendering of the captured scene, falls within the scope of the present 
invention. 

The catalog described in Fig. 1 can be a brochure, a sign, an 
advertisement or a poster. The catalog can be a film processing envelope, an 

5 order form, a bill, or a receipt. The catalog can be represented in a printed form 
on a reflection material or by an electronic display technology, such as a computer 
monitor, a liquid crystal display (LCD), a television, or a personal digital assistant. 
It can be represented by a verbal description suitable for receipt by a voice 
technology, such as cellular telephone. It is a common practice for a 

1 0 photofmisher, when receiving film for processing, to supply the customer with a 
processing envelope; when the photofmisher is a wholesale, mail order institution, 
the processing envelope can be sent through the mail (i.e., a mailer). The 
customers exposed film is placed in the processing envelope and sealed, with 
customer order information such as name, order options, billing method, and a 

1 5 means of contact such as a daytime telephone number commonly supplied. Figure 
2 A shows the front side 3000a of a film-processing envelope for photofmishing 
services that offer the selection of different image looks (section 3001a) from a 
single film capture medium. The backside 3000b of a film-processing envelope is 
shown in Fig. 2B, which provides a catalog (section 3001b) of some available 

20 image looks. 

On the processing envelope are commonly found check-off boxes, 
which provide a menu of options for the photofmishing order. For example, the 
processing envelope can offer various print sizes, single or duplicate prints, and 
enlargements; it is preferred for the envelope to disclose photofmishing options 

25 around variable image appearances. For the purposes of the invention, the catalog 
can constitute a description on the film container itself or any associated 
packaging that indicates the possible use of the film to provide multiple looks. It 
is common trade practice with consumer photographic films to describe the 
applications of the product on the container box both on the inside and on the 

30 outside. It is also contemplated that the camera used to expose the film can 

interrogate a microchip, a magnetic coating, or other information storage means 
associated with the film, or its cartridge or cassette, in order to determine the 
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possible use of the film to provide a selection of image appearances. In an 
especially preferred form of the invention, the catalog is represented by a World 
Wide Web (WWW) page on the Internet. It is contemplated that the customer 
may purchase both unexposed film and its processing through the same channel at 
5 the same time, or through different channels at different times and, after taking 
pictures, return the exposed film to the photofinisher for development and image 
processing. There is no requirement that the film bear an indication of its 
suitability for photofinishing to provide multiple appearances (e.g., an advertised, 
conforming use). Only the photofinisher, his intermediaries, or his agents need to 

1 0 provide a description of the photofinishing service that provides a selection of 

image appearances according to the invention. For the purposes of the invention, 
the customer can be a single individual, such as the photographer who exposed the 
photographic recording material, or a retail client of the photofinishing service, or 
he may represent a group of individuals buying services as a consortium (e.g., a 

1 5 club, a cooperative, a business, a firm, an institution, a government organization). 
The photofinisher can be an actual operation that conducts all of the technical 
work of film scanning, image processing, image transmission, processed image 
printing, etc., or the photofinisher can be a service providing party that offers one 
of more services to customers and that in turn receives one or more of the needed 

20 technical steps or services from a different service provider. In one example of 
the invention, the photofinisher is a service provider, which only deals in 
reprinting previously developed film. 

The characteristic appearance that is produced by the invention can 
be represented by a verbal description, a written description, by icons, by 

25 graphical means, or by pictorial description, or by a combination of the various 
means. It is preferred to represent the different image looks produced by the 
invention with a pictorial representation, in particular a sample image. It is 
recognized, however, that the limitations of the printing methodology may 
compromise the quality of the representation. It is also appreciated that the visual 

30 ability or acuity of the viewer or purchaser will vary among the population. The 
lighting under which the customer views the brochure, the viewer's state of 
adaptation, or even the production features of the catalog may affect his 
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perception of the nature of the look. Therefore it is highly preferred to 
supplement pictorial representations of the image looks with text descriptions of 
the properties of the looks. It is preferred to describe the image looks in terms of 
the presence or absence of color (that is, a color image, a black-and-white image, 
5 or a sepia image, for example), image contrast, image colorfulness, image hue 
rendition, and image sharpness and graininess. It is also possible to compare the 
offered looks to existing film products known for characteristic or trademark 
looks. It is also possible to characterize the looks by a ranking system, such as: 
good, better, best. It is furthermore possible to characterize the image looks by 

10 customer segmentation; for example, color rendition preferred by teenagers, by 
artists, by professional photographers, or by geographical, regional or cultural 
preference. It is preferred to represent the image looks by application such as 
landscape, portraiture, baby picture, candid or grab shot, party scene, dreary day, 
snow or beach scene, and so forth. The image looks can also be characterized by 

1 5 their suitability for a particular viewing condition or lighting condition during 
exposure such as bright lighting levels, low lighting levels, tungsten lighting, 
natural daylight illumination, artificial fluorescent illumination, and so forth. The 
image looks can furthermore be characterized by their suitability for viewing by a 
particular segment of the population, such as young persons with excellent visual 

20 acuity, middle-aged people with farsightedness, and the elderly with declining 
visual abilities. 

In a highly preferred embodiment, the photofinishing catalog or 
brochure is displayed on the Internet as a WWW page. The Internet comprises a 
large number of computers and computer networks that are interconnected 

25 through communication links. The interconnected computers exchange 

information using various services, such as electronic mail, Gopher, and the Web. 
The Web service allows a server computer system (a Web server or Web site) to 
send pages of graphical information to a remote client computer system. The 
remote client computer system can then display the Web pages. Each source of 

30 content that is a computer Web page of the WWW is uniquely identifiable by a 
Uniform Resource Locator (URL). In order to view a specific Web page, the 
client computer system specifies the URL for that Web page in a request. The 
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request is forwarded to the Web server that supports that Web page. When the 
Web server receives the request, it sends that Web page to the client computer 
system. When the client computer system receives that Web page, it typically 
displays the Web page using a browser program. A browser is a special-purpose 
application program that conducts the requesting of Web pages and the displaying 
of Web pages. 

The WWW of the Internet is a particularly suitable means to both 
display the image looks and to interact with the customer to accept an order and 
generate a billing transaction. An Internet-based catalog can have an introductory 
page identifying the service and provider, a tutorial page, a sample image page, an 
ordering page for the photographic recording material or the image processing 
services, and the address or location of available retail laboratories or sites 
offering the film, photofmishing service, or the bundled combination if available. 
Due to concerns about home monitor calibration, it would be preferred to 
represent the sample images in an exaggerated form that emphasizes the 
differences between the image the looks, and to supplement the images with text 
descriptions of the properties of the look. It is contemplated to make sample 
image looks available for downloading as image files (e.g., a tagged-image-file- 
format (TIFF) file) over the Internet for home printing so that a customer can see 
sample images prepared on his home printing equipment, such as an inkjet printer. 
An example of printing over a network is KODAK PHOTONET ONLINE service 
offered by Eastman Kodak Company, Rochester, New York. 

In step 102 (Fig. 1), a photofmishing service receives the 
customer's exposed scan film. While any camera speed photographic recording 
material, or image file derived from a recording material (e.g., a film scan), a 
recorded image (e.g., a print scan image file) or an electronic recording device 
(e.g., a digital still camera), can be employed in the practice of this invention, the 
ability to provide superior image capture and storage properties and electronic 
image processing capability is greatly facilitated by employing a film designed for 
scanning. A film intended for scanning can be characterized by having low 
suitability for both direct viewing (e.g., projection) and optical printing. The film 
intended for scanning may be suitable for wet, aqueous processing including 
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lamination and chemical transfer methods, or it may be suitable for dry, thermal 
processing by being comprised of incorporated development chemicals. 

In one embodiment, a dry-process film intended for scanning can 
be characterized as a light sensitive silver halide photographic recording material 
having an incorporated developer in a binder on a support and capable of forming 
a differentiable machine-readable image which includes a non-diffusible dye by 
the application of heat. 

In a second embodiment, a dry-process film intended for scanning 
can be characterized as a light sensitive silver halide photographic recording 
material capable of forming a differentiable machine-readable image which 
includes a non-diffusible dye by the application of little to no processing solvent 
and a laminate layer, wherein the dry-process film or the laminate layer has an 
incorporated developer. 

Suitable dry-process films and suitable components are described 
by Irving et al. in U.S. Serial No. 09/475,510 filed 30 December 1999, and by 
U.S. Patent Nos. 6,048,110 to Szajewski et al.; 5,756,269 to Ishikawa et al.; 
5,858,629 to Ishikawa et al.; 6,022,673 to Ishikawa; 5,888,704 to Kikuchi; 
5,965,332 to Kikuchi; 5,851,749 to Okawa et al.; 5,851,745 to Takeuchi; 
5,871,880 to Makuta et al.; 5,874,203 to Morita, et al.; 5,945,264 to Asami et al.; 
5,976,771 to Kosugi et al. and 6,051,359 to Ohkawa et al.. 

The film intended for scanning can have long exposure latitude, at 
least 2.5 log E, preferably at least about 3.0 log E, more preferably at least about 
3.5 log E and even more preferably at least about 4.0 log E. The long latitude 
facilitates proper capture of the total range of scene light levels under a variety of 
lighting conditions and illuminant types. The film can have a high sensitivity, 
preferably having an equivalent threshold sensitivity of at least about ISO 100, 
more preferably having an equivalent threshold sensitivity of at least about ISO 
200 and most preferably having an equivalent threshold sensitivity of at least 
about ISO 400. Equivalent threshold sensitivities of about ISO 800 are useful in 
one-time-use cameras (OTUCs) based on 35-mm format film, and equivalent 
threshold sensitivities of up to about ISO 6400 are specifically contemplated. The 
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high sensitivity further facilitates capture of scene light levels under poor lighting 
conditions of low illumination and when the scene subject is in motion, since the 
high sensitivity permits the use of a fast shutter time on a camera. 

A film intended for scanning can be additionally characterized as 
having very distinguishable properties from films intended for optical printing or 
direct viewing. The film can form a low gamma image after development. The 
low gamma, especially when combined with the long latitude, ensures that the 
formed densities are easily scanned without the introduction of scanner electronic 
noise produced by scanning through high net density (density above the minimum 
density). Image gammas of up to about 0.7 are preferred, gammas of up to about 
0.55 are more preferred and image gammas of up to about 0.45 are even more 
preferred. The film can exhibit a minimal gamma after development processing. 
Image gammas of about 0.2 are specifically contemplated. Certain methods of 
scanning allow an almost imperceptible image to be rendered into electronic 
image-bearing signals. Although a black-and-white film can be employed to 
facilitate some of the features of the invention, a color film can best exploit the 
full features of the present invention. When the film is a color film, it can have 
individual layer units each sensitive to red, green or blue light, such as the film 
intended for scanning described in EP-A-0 905 561 (published March 31, 1999). 
Alternatively, the film can have layer units sensitive to white light and to specific 
subsets of white light as described in U.S. Patent Nos. 5,962,205 to Arakawa et al. 
and 5,053,324 to Sasaki. While the layer units of a color film intended for 
scanning can be sensitized using any known color sensitization scheme, they are 
preferably sensitized in a manner that approximates the sensitivity of the human 
eye, which allows the accurate recording of scene light types as well as levels and 
which provides scene colorimetry. Since colorimetric capture requires linear 
space signal processing, it is incompatible with traditional chemical image 
processing practiced by color negative films intended for optical printing and 
color reversal films intended for direct viewing. Colorimetric recording is a 
desirable trait of films intended for scanning and electronic image processing, 
because image data with known color accuracy can be more manipulated to a 
much higher extent before color errors become objectionable, which in turn 




provides a larger range of possible image looks. A useful sensitization method, 
element and image-processing scheme for colorimetric capture is described in 
U.S. Patent No. 5,582,961 to Giorgianni et al. More preferred spectral sensitizing 
dyes and methods for colorimetric recording emulsion sensitization are disclosed 
5 by EP-A-0 978 762 (published February 9, 2000), which claims priority from U.S. 
Serial No. 09/126,658, filed August 5, 1998, and U.S. Patent Nos. 6,093,526 and 
6,143,482 to Buitano et al. Colorimetric-recording negative films especially 
useful in the practice of the invention are further described in U.S. Patent No. 
6,045,983 to Buitano et al., U.S. Patent No. 6,146,818 to Gonzalez et al, and U.S. 

10 Serial No. 09/259,694 filed March 1 , 1999. 

When the film intended for scanning is a color negative film, it is 
preferably comprised of little or no colored masking coupler as described in US 
Patent Nos. 5,698,379 and 5,840,470 to Bohan et al., and 6,021,277 to Sowinski et 
al., the disclosure of which is herein incorporated by reference. Masking coupler 

15 is incorporated in a color negative intended for optical printing and performs a 
color correction step during chemical development. Elimination of the masking 
coupler provides for improved signal-to-noise characteristics during chemical 
development and obviates the need to electronically counteract its effect. In like 
manner, the film preferably exhibits low levels of interlayer interimage effects 

20 overall, since electronic signal processing will be relied upon for color correction 
and image structure enhancement. In a preferred embodiment, each layer unit of a 
color film will comprise less than about 0.02 mmole/m 2 of colored masking 
coupler. Since colored masking couplers are not required in color negative films 
intended for scanning, the processed film may be better adapted for visual 

25 appearance and inspection, in addition for scanning, as described in U.S. Patent 
No. 5,972,585 to Sowinski et al. 

It is conventional practice with color photographic recording 
materials used for printing or for direct viewing to have blue, green, and red light 
recording layer units contain yellow, magenta, and cyan image dye- forming 

30 couplers, respectively. In color photographic recording materials intended for 
scanning to produce three separate electronic color records, the actual hue of the 
image dye produced is of no importance. What is essential is merely that the dye 




image produced in each of the layer units be differentiable from that produced by 
each of the remaining layer units. To provide this capability of differentiation, it 
is contemplated that each of the layer units contains one or more dye image- 
forming couplers chosen to produce image dye having an absorption half-peak 
5 bandwidth lying in a different spectral region. It is immaterial whether the blue, 
green, or red recording layer unit forms a yellow, magenta, or cyan dye having an 
absorption half peak bandwidth in the blue, green, or red region of the spectrum, 
as is conventional in a color negative element intended for use in printing, or an 
absorption half peak bandwidth in any other convenient region of the spectrum, 

10 ranging from the near ultraviolet (300-400 nm) through the visible and through the 
near infrared (700-1200 nm), so long as the absorption half peak bandwidths of 
the image dye in the layer units extend in non-coextensive wavelength ranges. 
Preferably each image dye exhibits an absorption half-peak bandwidth that 
extends over at least a 25 (most preferably 50) nm spectral region that is not 

1 5 occupied by an absorption half-peak bandwidth of another image dye. 

Light sensitive elements or films useful in the practice of this 
invention can be supplied in standard film cartridges or in thrust cartridges or 
cassettes, all as known in the art. Thrust cartridges are disclosed by U.S. Patent 
Nos. 5,226,613 to Kataoka et al; 5,200,777 to Zander; 5,031,852 to Dowling et 

20 aL; 5,003,334 to Pagano et al.; and 4,834,306 to Robertson et al. These thrust 

cartridges can be employed in reloadable cameras designed specifically to accept 
them, in cameras fitted with an adapter designed to accept such film cassettes or in 
one-time-use cameras designed to accept them. Narrow-bodied one-time-use 
cameras suitable for employing thrust cartridges are described in U.S. Patent No. 

25 5,692,221 to Tobioka et al. While the film can be mounted in a one-time-use 

camera in any manner known in the art, it is especially preferred to mount the film 
in the one-time-use camera such that it is taken up on exposure by a thrust 
cartridge. Film supplied in a thrust cartridge can be supplied in any convenient 
width. Widths of about 24 mm as employed in the Advanced Photo System™ 

30 (APS) are contemplated as well as wider formats, such as 35 mm or even wider. 

Photographic recording materials intended for scanning that are 
particularly useful in the practice of the invention can be prepared by coating light 
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sensitive silver halide emulsion units on a support with magnetic recording 
capability. Magnetic recording layers on film permit the encoding of information 
with specific images or with a the entire film roll, and they are described in 
Research Disclosure Item 38957, pages 626-627 (September 1996) Section XIV 
5 Scan facilitating features paragraph (2). Research Disclosure is a publication of 
Kenneth Mason Publications Ltd., Dudley House, 12 North Street, Emsworth, 
Hampshire PO10 7DQ England (also available from Emsworth Design Inc., 121 
West 19th Street, New York, N.Y. 1001 1). Information useful in the practice of 
the invention can be exchanged between the film and the camera, the film 

10 manufacturer and the photofinisher, the customer and the film manufacturer, and 
so forth, as disclosed in U.S. Patent Nos. 5,229,810 to Cloutier et al.; 4,987,439 to 
Cloutier; 5,027,140 to Cloutier; 5,130,745 to Cloutier et al.; 5,021,820 to Robison 
et al.; 4,965,626 to Robison et al.; 4,974,096 to Wash; 5,204,708 to Whitfield et 
al.; 5,029,313 to Robison et al; 5,006,873 to Wash; 5,194,892 to Robison; 

15 5,025,283 to Robison; 5,726,737 to Fredlund et al.; 5,609,403 to Bell et al. and 
5,276,472 to Belletal 

The exposed scan film can be received at a retail site such as a 
photo specialty store, a drug store, a department store, or a grocery store. The 
film can be deposited at a drop-off point, a kiosk, or mailed via the U. S. Postal 

20 Service using a mailer envelope. The customer can be presented with the option 
of choosing the photographic look that he desires for the planned images. In 
another embodiment, he customer can instead order a single default look from 
which to judge his images. The customer can order multiple image renditions 
derived from the same scene image, or he can order a single image per film frame 

25 wherein the look or characteristic appearance of the image is selected by the 
photofinisher, perhaps for optimum image quality based on scene content or 
photographic exposure, or perhaps based on a pricing structure. In a preferred 
embodiment of the invention, the customer can view imagettes (i.e., thumbnail 
images as used in a film order index print) displayed by a monitor screen through 

30 the Internet; in another embodiment, the imagettes are sent to the customer by e- 
mail for his examination before the full image data is processed. In yet another 
embodiment of the invention, the imagettes are displayed in real-time by a 
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photographic processing kiosk. In still other embodiments, it is contemplated that 
the customer will have an option to select the images that he wishes to print or 
render for a fee, which can be referred to as a photo-select process. An example 
of such a selection methodology is described in U.S. Patent No. 5,666,215 to 
Fredlund, et al. Especially suitable methods of digital photofmishing and image 
distribution involving a networked computer means are described in U.S. Patent 
Nos. 6,017,157 and 6,133,985 to Garfmkle et al. 

In step 102 (Fig. 1), it is preferred to assign a unique code to the 
customer photofmishing order. It is common practice in the photofmishing trade 
to supply an order number with a processing envelope in order to return the 
correct processed film and prints to a particular customer. An analogous strategy 
can be used with a processing kiosk. Other kinds of identifying codes can be 
present in the order. For example, the film cartridge or cassette can be encoded 
with an identifier for film type, processing conditions, film speed, or image 
processing requirements. In a similar fashion, the film can have a magnetically 
recorded encodement or a pre-exposed encodement, such as a bar-code on the 
edge of the film outside the frame area, to identify image processing requirements, 
manufacturer's correction factors, and so forth. The order identifier associated 
with the transaction can be used to facilitate the purchase of reprints or 
enlargements of particular frames, if the customer later desires. The order number 
can be associated with an index print, if provided, or with the customer's returned 
images in either hard copy or soft copy form. It is preferred to associate the order 
number with the digital file from the customer's order through the course of image 
processing and the completion of the transaction. A more permanent kind of 
identifying number can be assigned to a customer in order to process future 
orders. For example, a customer account can be established using a telephone 
number, an e-mail address, or a credit card number as a customer identifier, as 
illustrated in a representative Web page account generation process 700 shown in 
Fig. 3. During the course of the transaction, if the customer chooses a particular 
look, that choice can be stored along with the code number in the customer 
database. In this manner, a customer profile can be established, at the discretion 
of the customer. The customer code can be stored in the customer database and 
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the identity of the customer's chosen look or preferences can be retrieved and 
associated with future purchases, if desired. In particular, if the customer has 
specific, permanent choices in mind, the processing envelope (or kiosk 
transaction) can be pre-endorsed with the chosen look(s) for future orders. 



5 



Referring now to step 106 of Fig, 1, it is determined which image 



look (or looks) are to be applied to the customer's input image data file prior to the 
completion of image processing in order to fulfill his order. In one embodiment 
of the invention, the customer chooses the particular look or looks for his image 
order. The customer can choose the particular look at the time of order placement 

10 for photo finishing following photography, and the processing envelope or mailer 
can be marked with the chosen look properties. Alternatively, the processing 
envelope can be pre-endorsed by the photofinisher based on customer preference 
data from prior usage of the service. In these circumstances, the looks selections 
are transmitted to the image processing equipment by codes or tags that have the 

1 5 customer order number associated with them. After photography, the customer 
has the option of changing the requested look by marking the processing envelope 
or mailer before returning it and the exposed film to the photofinisher. In another 
variation, the customer can record a preselected look on the film from a camera, 
before, during, or after image capture by using magnetic information storage such 

20 as found in Advanced Photographic System cameras, or by encoding a selection in 
an integrated circuit resident in a film cartridge or cassette. If the customer has a 
film camera with an associated auxiliary digital still capture device and display as 
disclosed in U.S. Patent No. 5,777,677 to Miyake et aL, such as a mounted LCD 
display or organic light emitting diode (OLED) display for instant image 

25 verification, then the customer can utilize an image looks menu for preview and 
display and make a selection at the time of image capture (or picture taking) for 
future order processing. 



for order placement and image look selection. Figure 4A shows an Internet 
30 WWW page 800, which displays the results (section 801) of applying various 

available looks to a customer's image, and which allows the customer to select the 
image look on a per- frame or whole-order basis (sections 802 ? 803). In the 



In another embodiment of the invention, the Internet can be used 
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example of Fig. 4A, the customer has chosen to view up to 4 looks on one frame 
and to select their picture look themselves. These selections are then transmitted 
to the image processing equipment with the customers order number. The 
customer may care to have additional information associated with his image, such 
5 as text, as disclosed in EP-A-0 851 661 (published July 1, 1998) or U.S. Patent 
Nos. 6,005,972 to Fredlund et al. and 5,986,671 to Fredlund et al., voice or 
musical annotations as disclosed in U.S. Patent Nos. 5,774,752 to Patton et al. and 
5,878,292 to Bell et al., or picture sequencing to form an electronic photo album 
as described in U.S. Patent No. 5,574,519 to Manico et al., which is illustrated by 

10 the example WWW page 900 of Fig. 4B; such operations are conveniently 
recorded in the photofinishing order at this time. 

In another embodiment of the invention and as a further example, 
the photofinisher or an algorithm selects the looks to be applied to the individual 
image frames based upon scene content, pictorial quality optimization, and so 

15 forth, as also suggested in section 804 of Fig. 4A. In this circumstance, the look 
determination can be performed by an algorithm that determines the properties of 
an individual image frame based on its image content. For example, a scene 
balance algorithm will provide color balance and density balance information for 
printing an image; it, or an image analysis algorithm, could also provide 

20 indications of scene content (i.e., the presence of sky, the presence of grass, the 
presence of a principal human subject, the presence of a face, the frame 
orientation, high lighting contrast (sunny day or electronic flash), low lighting 
contrast (overcast day), and so forth) upon which to base a selection of the 
optimum look in an automated fashion. 

25 Referring to step 103 of Fig. 1, the customers exposed scan film 

is chemically processed to produce a scanable image. In one embodiment of the 
invention, a full, conventional color process is carried out to provide a normal 
appearing, processed color negative film. In another embodiment of the 
invention, the chemical processing can be accelerated; the omission of tail-end 

30 processing steps such as washing is specifically contemplated. In yet another 
embodiment of the invention, the chemical processing can be limited to only a 
development step, which can involve aqueous processing chemicals or can 



alternatively involve thermal processing. A color photographic silver halide 
material comprised of a blocked but releasable photochemical (such as a 
blocked but releasable color developing agent) can be processed and used with 
the present invention. Such a material is disclosed for example in U.S. Serial 
5 No. 09/475,5 1 0 filed 30 December 1 999 by Irving et al. The apparatus can be 
employed to process film in a free standing customer accessible kiosk as 
described in EP-A-0 234 833 (published on September 2, 1987), U.S. Patent 
Nos. 5,113,351 to Bostic, 5,627,016 to Manico and 5,664,253 to Meyers. For 
the purposes of this invention, photothermographic materials providing color 

1 0 images are considered to be within the definition of "color photographic 
recording materials intended for scanning". Color processing satisfying the 
requirements of the invention can also be accomplished by lamination methods, 
such as illustrated by U.S. Patent Nos. 5,756,269 to Ishikawa et al.; 6,022,673 to 
Ishikawa and 6,030,755 to Matsumoto et al. Aerial deposition development 

15 methods associated with co-called electronic film development as described in 
U.S. Patent Nos. 5,988,896 to Edgar and 6,017,688 to Edgar are also specifically 
contemplated, since such methods can be expected to perform especially well 
with films intended for scanning. 

Satisfactory conventional color processing methods using 

20 conventional processing components, providing both color negative and color 
reversal images, are well known, as described for example, in Research 
Disclosure publication 308119, December 1989, publication 17643, December 
1978, and publication 38957, September, 1996. Color developing compositions 
and processing conditions useful in rapid color development are disclosed for 

25 example in U.S. Patent Nos. 5,1 18,591 to Koboshi et al.; 5,753,424 to Ishikawa 
et al. and 5,922,519 to Ishikawa et al. It is preferred to use a full color process 
with bleaching and fixing steps to provide color negatives intended for scanning 
that are free of retained silver metal and silver halide in order to improve 
scanning quality, but the invention can be practiced with any scanable, 

30 processed photographic recording material bearing an image. It is preferred, 
where appropriate to the requirements of the particular scan film, to use the 
KODAK FLEXICOLOR™ Process or C-41 Process, as described by The 
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British Journal of Photography Annual of 1988, pp. 196-198. Another 
description of the use of the FLEXICOLOR™ Process is provided by Using 
Kodak Flexicolor Chemicals, Kodak Publication No. Z-131, Eastman Kodak 
Company, Rochester, NY. 
5 In step 104 of Fig 1, the imagewise exposed and processed 

photographic recording material intended for scanning according to the invention 
is scanned. Figure 5 shows, in block diagram form, a manner in which the 
recorded image information provided by the processed material can be used. A 
film scanner 502 is used to read processed scan film 501 by transmission; 

1 0 similarly, a reflection print scanner 504 or a digital still camera 503 can also 

provide data input into the image processing system. The scanning beam is most 
conveniently a beam of white light that is split after passage through the film layer 
units and passed through appropriate filters to create separate image records — red 
recording layer unit image record (R), green recording layer unit image record 

1 5 (G), and blue recording layer unit image record (B). Instead of splitting the beam, 
blue, green, and red filters can be sequentially caused to intersect the beam at each 
pixel location. In still another scanning variation, separate blue, green and red 
light beams, as produced by a collection of light emitting diodes, can be directed 
at each pixel location. As the element is scanned pixel-by-pixel using an array 

20 detector, such as an array charge-coupled device (CCD), or line-by-line using a 
linear array detector, such as a linear array CCD, a sequence of R, G, and B 
picture element signals are generated that can be correlated with spatial location 
information provided from the scanner. Signal intensity and location information 
is fed to a computer digital image processor 505 preferably associated with a 

25 general control processor computer workstation 510 and the information is 

transformed into intermediary image-bearing electronic signals R', G f , and B', 
which can be stored in any convenient storage device associated with the general 
control processor workstation 5 1 0 or in off-line storage 511. Digital image 
processor 505 by means of general control processor workstation 510 can transmit 

30 information to and receive information from a computer network 512. It is 

preferred that the computer network be linked to the Internet, and more preferably 
to the World Wide Web. 
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A video monitor 509 which receives the digital image information 
modified for its requirements, indicated by R" G" and B", allows viewing of the 
image data information received and used by the workstation. Instead of using the 
cathode ray tube (CRT) of a video monitor, a LCD or OLED panel or any other 
5 convenient electronic display device can be substituted. General control processor 
apparatus 510 which can include a keyboard and pointing device such as a mouse 
or trackball 513 enables the workstation operator to provide image manipulation 
instructions for modifying the video image displayed and any image reproduction 
to be created from the image-bearing electronic signals. 

10 Modifications of the image data can be viewed on video display 

509 as they are being performed and then saved in storage device 511. The 
modified image data in suitable form R"' ? G'", and B'" can be sent to an output 
device to produce a hard copy scene reproduction for viewing. The output device 
can be any convenient conventional writing device, such as a CRT or laser silver 

15 halide color paper writer 506, a thermal dye transfer printer, an inkjet printer 507, 
an electrostatic, electrophotographic, or another type of printer. The modified 
image information can also be stored on a transportable recording medium such as 
a compact disc (CD) produced by a CD writer 508. 

It is contemplated to connect the photofinishing image processing 

20 workstation of Fig. 5 to an extensive computer communications network as shown 
in Fig. 6. A workstation 607 with attendant operator input and output capabilities 
fulfilled by a keyboard and monitor display 608 can serve as a retail operation. In 
order to provide WWW interactive customer services, and to communicate with 
other photofinishing service operations, workstation 607 is linked through a 

25 connection computer, such as a server 602a, to a network 601 . Through network 
601 and another connection computer 602b, workstation 607 can communicate 
with wholesale photofinishing computer operations 604, to provide distributed 
image processing, storage, Web display, or printing services. The retail computer 
workstation can communicate with customers directly if desired through a 

30 personal computer 606, a kiosk 605, or through a mobile computer or computing 
device 603, such as a laptop computer, a personal digital assistant, or a cellular 
phone. Therefore, the present invention can take the form of a computer program 
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product which includes a computer readable storage medium having a computer 
program stored thereon. The computer program product when loaded into a 
computer would cause the computer to perform the operation as described in the 
present application 

5 Further, the photofinishing can be accomplished by a kiosk system, 

a microlab system, a minilab system, or a high productivity wholesale 
photofinishing system, either in one location or in multiple locations with separate 
operations. Image data and other pertinent information may be input and output 
by reading and writing operations, respectively, from magnetic storage media or 

10 optical storage. Data, communications, billing, and so forth may be transferred by 
optical transmission means (e.g., direct infrared transmission or fiber optical 
network), or electromagnetic transmission means (e.g., wireless broadcast, 
Ethernet, cable or telephone line transmission). 

Referring to step 104 in Fig 1. again, once distinguishable images 

15 of one or more color records have been formed in the processed photographic 
materials, conventional techniques can be employed for retrieving the image 
information for each color record and manipulating the record for subsequent 
creation of a color-balanced, viewable image. As the element is scanned pixel-by- 
pixel using an array detector, such as an array CCD, or line-by-line using a linear 

20 array detector, such as a linear array CCD, a sequence of R, G, and B picture 
element signals are generated that can be correlated with spatial location 
information provided from the scanner. Scanning can also be carried out by a 
microdensitometer. Signal intensity and location information can be fed to an 
image data processor and the information is transformed into an electronic form, 

25 which can be stored in any convenient storage device. For example, it is possible 
to scan a color photographic material successively within the blue, green, and red 
regions of the spectrum or to incorporate blue, green, and red light within a single 
scanning beam that is divided and passed through blue, green, and red filters to 
form separate scanning beams for each color record. If other colors are imagewise 

30 present in the material, then appropriately colored light beams are employed. A 
simple technique is to scan the photographic material point-by-point along a series 
of laterally offset parallel scan paths. A sensor that converts radiation received 
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into an electrical signal quantifies the intensity of light passing through the 
material at a scanning point. Most generally this electronic signal is further 
manipulated to form a useful electronic record of the image. For example, the 
electrical signal can be passed through an analog-to-digital converter and sent to a 
5 digital computer together with location information required for pixel (point) 
location within the image. In another variation, this electronic signal is encoded 
with colorimetric or tonal information to form an electronic record that is suitable 
to allow reconstruction of the image data into viewable forms such as computer 
monitor displayed images, television images, printed images, and so forth. 

10 In motion imaging technologies, a common approach is to transfer 

the color negative film information into a video signal using a telecine transfer 
device. Two types of telecine transfer devices are most common: (1) a flying spot 
scanner using photomultiplier tube detectors; and (2) a CCD as a sensor. These 
devices transform the scanning beam that has passed through the color negative 

15 film at each pixel location into a voltage. The signal processing then inverts the 
electrical signal in order to render a positive image. The signal is then amplified 
and modulated and fed into a CRT monitor to display the image, and it is recorded 
onto magnetic tape for storage. Although both analog and digital image signal 
manipulations are contemplated, it is preferred to place the signal in a digital form 

20 for manipulation, since the overwhelming majority of computers are now digital 
and this facilitates use with common computer peripherals, such as magnetic tape, 
a magnetic disk, an optical disk, and a writing or printing device. 

In another embodiment of the invention illustrated by step 105 of 
Fig.l, the image data information acquired in preceding fashion from a film 

25 intended for scanning can be transmitted to the photofinisher's image processing 
workstation by a sending party, using any convenient method, such as a 
networked computer system. There is no requirement that the photo finisher scan 
the film in order to provide a selection of processed image reproduction 
appearances according to the invention. The sender can be a customer or a 

30 photographer possessing a home scanner and a modem who transmits an image 
file; the sender can also be a kiosk, a retail photo specialty shop, and so forth. 
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While there is no requirement that the sender and the receiving photofinisher be at 
different locations, it is envisioned that the largest benefit is obtained when file 
transfers occur over appreciable distances associated with different locations due 
to the computer infrastructure requirements in establishing a network system. It 
5 will be appreciated that the best image processing results will be obtained if the 
transmitted image file has a data encodement or color encodement scheme 
consistent with that of the image processing scheme to ensure full compatibility. 
It is preferred that transmitted data be compressed in order to improve throughput 
in network communications where available bandwidth is limited or where there 
10 is congestion due to data traffic, as is common. When file compression means are 
used, it is preferred that they be lossless rather than lossy. It is highly preferred 
that transmitted data be accompanied by metadata encoding. 

Within the context of the present invention, image metadata refers 
to any additional data or information associated with the image; it may be 
1 5 derivative of the image itself, or it may relate to added material that pertains to the 
event of photography, customer identification or preferences, or photofinisher 
routing information. Diverse examples of metadata and its encoding that are 
applicable to the invention can be found in U.S. Patent No. 6,1 15,717 to Mehrota 
et al.; U.S. Patent No. 5,893,101 to Balogh et al.; EP-A-1 004 967 (published on 
20 May 31, 2000); and U.S. Patent No, 6,134,315 to Galvin. Photographic capture 
information that is desirably encoded as metadata includes any single input or any 
combination of inputs regarding scene illumination type, flash parameters such as 
flash output and/or whether the flash was directed at the subject or bounced onto 
the subject and/or whether sufficient flash power was available to properly 
25 illuminate the subject, camera lens f-stop, camera exposure time, and scene 
orientation, all of which is helpful in color and density balancing. 

It is specifically contemplated to scan a developed image to red, 
green and blue light to retrieve imagewise recorded information and to scan the 
same image to infrared light for the purpose of recording the location of non- 
30 image imperfections. When such an imperfection or "noise" scan is employed, 
the signals corresponding to the imperfection can be employed to provide a 
software correction so as to render the imperfections less noticeable or totally 



imperceptible in soft or hard copy form. The hardware, software and technique 
for achieving this type of imperfection reduction is described in U.S. Patent No. 
5,266,805 to Edgar and WO 98/31 142 (Edgar et al.), WO 98/34397 (Edgar et al.), 
WO 99/40729 (Edgar et al.) and WO 99/42954 (Edgar et al.). An example of a 
5 preferred scanner employing such corrections is the KODAK DLS Film Scanner 
1640 with an associated image data manager, such as one or more dual-processor 
computers. 

In another embodiment, the developed image can be scanned 
multiple times by a combination of transmission and reflection scans, optionally in 

10 the infrared and the resultant files combined to produce a single file representative 
of the initial image. Such a procedure is described in U.S. Patent Nos. 5,465,155 
to Edgar; 5,519,510 to Edgar; 5,790,277 to Edgar; and 5,988,896 to Edgar, as well 
as EP-A-0 944 998; WO 99/43148; WO 99/43149 and WO 99/42954. 
Improvements in the scanning of films that retain silver halide following a rapid 

15 development method, such as aerial chemical deposition, are obtained by methods 
disclosed in U.S. Patent No. 6,069,714 to Edgar. 

Elements having reference images or calibration patches derived 
from one or more uniform areas exposed onto a portion of unexposed 
photographic material as described in U.S. Patent Nos. 5,649,260 to Wheeler et 

20 al, 5,563,717 to Koeng et al. and 5,644,647 to Cosgrove et al. can be usefully 
employed to overcome the effects of excessive sensitometric variation. The 
exposure of reference images for the purpose of better calibrating the image 
processing system can be performed by the photographic recording material 
manufacturer or by the photofinisher. Periodic system calibration events (e.g., a 

25 daily calibration) employing reference exposure patches even on a single 

representative material, such as those contained on a chemical process control 
strip, can lead to improved image processing results. It is preferred to employ a 
calibration reference image on every roll of film that is processed by the 
photofinisher. An especially suitable method for calibration and correction due to 

30 processing solution activity changes or film responsivity changes is taught in U.S. 
Patent No. 5,667,944 to Reem et al,, the disclosure of which is herein incorporated 
by reference. Other useful features of element construction for scanning and 



• -30- Q 



image-bearing signal manipulation can be found in Research Disclosure, 
publication 38957, pages 626-627 (September 1996) Section XIV Scan 
facilitating features. 

Once acquired, the image data in electronic signal form derived 
5 from the input capture material or device color records can be adjusted for scene 
exposure conditions to produce a more pleasingly color-balanced and lightness - 
balanced image for viewing. An example of a suitable scene balance algorithm is 
described by. E.Goll, D. Hill, W. Severin, 'Modern Exposure Determination for 
Customizing Photofmishing Printer Response", Journal of Applied Photographic 

10 Engineering, 2, 93 (1979). Techniques for transforming image-bearing signals 
after scanning are disclosed in U.S. Patent No. 5,835,627 to Higgins et al., U.S. 
Patent No. 5,694,484 Cottrell et al. and U.S. Patent No. 5,962,205 to Arakawa et 
al. Techniques for color balance adjustments during scanning are disclosed in 
U.S. Patent No. 5,049,984 to Moore et al and U.S. Patent No. 5,541,645 to Davis. 

1 5 Further illustrations of general procedures and system considerations involved in 
electronic image processing are described by Giorgianni and Madden, Digital 
Color Management: Encoding Solutions, Addison- Wesley, Reading, 
Massachusetts, 1998. 

In order to deliver an image reproduction that incorporates one or 

20 more appearances selected by a customer or photofinisher, electronic signal 

processing (i.e., image processing) is carried out as indicated in step 107 of Fig. 1. 
Preferred techniques for transforming image-bearing signals after scanning are 
taught in U.S. Patent Nos. 5,267,030 to Giorgianni et al.; 5,452,1 1 1 to Giorgianni 
et al.; 5,956,044 to Giorgianni et al., and 5,609,978 to Giorgianni et al, the 

25 disclosures of which are herein incorporated by reference. Another preferred 
method for transforming the image-bearing electronic signals, or carrying out 
image processing of a film intended for scanning, is taught by U.S. Patent No. 
5,995,654 to Buhr et al., and in U.S. Patent Application Serial No. 09/104,548 
filed on 25 June 1998 by Buhr et al., "Digital Photofmishing System Including 

30 Digital Image Processing of Alternative Color Capture Media". 

Using an arrangement of the type shown in Fig. 5, the images 
contained in the color photographic recording material intended for scanning in 
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accordance with the invention are converted to digital form, manipulated, and 
recreated in a viewable form following any of the suitable methods described in 
U.S. Patent No. 5,276,030 to Giorgianni et al. In one preferred embodiment, 
Giorgianni et al. in '030 provide a method and means to convert the R, G, and B 
5 image-bearing signals from a transmission scanner to an image manipulation 

and/or storage metric which corresponds to the trichromatic signals of a reference 
image-producing device such as a film or paper writer, thermal printer, video 
display, etc. The metric values correspond to those, which would be required to 
appropriately reproduce the color image on that device. For example, if the 

10 reference image producing device was chosen to be a specific video display, and 
the intermediary image data metric was chosen to be the R', G 1 , and B 1 intensity 
modulating signals (code values) for that reference video display, then for an input 
film, the R, G, and B image-bearing signals from a scanner would be transformed 
to the R', G', and B ! code values corresponding to those which would be required 

15 to appropriately reproduce the input image on the reference video display. A data 
set is generated from which the mathematical transformations to convert R, G, and 
B image-bearing signals to the aforementioned code values are derived. Exposure 
patterns such as neutral and colored patches, chosen to adequately sample and 
cover the useful exposure range of the film being calibrated, are created by 

20 exposing a pattern generator and are fed to an exposing apparatus. The exposing 
apparatus produces trichromatic exposures on film to create test images, which 
include approximately 150 color patches. 

Test images may be created using a variety of methods appropriate 
for the application. These methods include: using an exposing apparatus such as a 

25 sensitometer, using the output device of a color imaging apparatus, recording 

images of test objects of known reflectances illuminated by known light sources, 
or calculating trichromatic exposure values using methods known in the 
photographic art. If input films of different speeds are used, the overall red, green, 
and blue exposures must be properly adjusted for each film in order to compensate 

30 for the relative speed differences among the films. Each film thus receives 
equivalent exposures, appropriate for its red, green, and blue speeds. The 
imagewise exposed film is chemically processed to produce a dye image. Film 
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color patches are read by a transmission scanner, which produces R, G, and B 
image-bearing signals corresponding to each color patch. Signal value patterns of 
the code value pattern generator produce R, G , and B intensity-modulating 
signals, which are fed to the reference video display. The R', G', and B' code 
5 values for each test color are adjusted such that a color matching apparatus, which 
may correspond to an instrument or a human observer, indicates that the video 
display test colors match the positive film test colors or the colors of a printed 
negative. A transform apparatus creates a transform relating the R, G, and B 
image-bearing signal values for the film's test colors to the R f , G', and B' code 
1 0 values of the corresponding test colors. 



image-bearing signals to the intermediary data may include a sequence of matrix 
operations and look-up tables (LUTs). 



15 bearing signals R, G, and B are transformed to intermediary data values 

corresponding to the R' ? G', and B r output image-bearing signals required to 
appropriately reproduce the color image on the reference output device as follows: 

(1) The R, G, and B image-bearing signals, which correspond to the 
measured transmittances of the film, are converted to corresponding densities in 

20 the computer workstation used to receive and store the signals from a film scanner 
by means of 1 -dimensional look-up table LUT 1. 

(2) The densities from step (1) are then transformed using matrix 1 
derived from a transform apparatus to create intermediary image-bearing signals. 



25 dimensional look-up table LUT 2 derived such that the neutral scale densities of 
the input film are transformed to the neutral scale densities of the reference. 

(4) The densities of step (3) are transformed through a 1 -dimensional 
look-up table LUT 3 to create corresponding R, G', and B' output image-bearing 
signals for the reference output device. 

30 It will be understood that individual look-up tables are typically 

provided for each input color. In one embodiment, three 1 -dimensional look-up 
tables can be employed, one for each of a red, green, and blue color record. In 



The mathematical operations required to transform R, G, and B 



In a preferred embodiment of the present invention, input image- 



(3) 



The densities of step (2) are optionally modified with a 1- 



another embodiment, a multi-dimensional look-up table can be employed as 
described in U.S. Patent No. 4,941,039 to D'Errico. It will be appreciated that the 
output image-bearing signals for the reference output device of step 4 above may 
be in the form of device-dependent code values or the output image-bearing 
5 signals may require further adjustment to become device specific code values. 
Such adjustment may be accomplished by further matrix transformation or 1 - 
dimensional look-up table transformation, or a combination of such 
transformations to properly prepare the output image-bearing signals for any of 
the steps of transmitting, storing, printing, or displaying them using the specified 
10 device. 

In a second preferred embodiment of the invention, the R, G, and B 
image-bearing signals from a transmission scanner are converted to an image 
manipulation and/or storage metric which corresponds to a measurement or 
description of a single reference image-recording or image-capture device and/or 

1 5 medium and in which the metric values for all input media correspond to the 
trichromatic values which would have been formed by the reference device or 
medium had it captured the original scene under the same conditions under which 
the input media captured that scene. For example, if the reference image 
recording medium was chosen to be a specific color negative film, and the 

20 intermediary image data metric was chosen to be the measured R, G, and B 

densities of that reference film, then for an input color negative film according to 
the invention, the R, G, and B image-bearing signals from a scanner would be 
transformed to the R', G\ and B' density values corresponding to those of an 
image which would have been formed by the reference color negative film had it 

25 been exposed under the same conditions under which the color negative recording 
material according to the invention was exposed. 

Exposure patterns, chosen to adequately sample and cover the 
useful exposure range of the film being calibrated, are created by exposing a 
pattern generator and are fed to an exposing apparatus. The exposing apparatus 

30 produces trichromatic exposures on film to create test images which include 

approximately 150 color patches. Test images may be created using a variety of 
methods appropriate for the application. These methods include: using an 
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exposing apparatus such as a sensitometer, using the output device of a color 
imaging apparatus, recording images of test objects of known reflectances 
illuminated by known light sources, or calculating trichromatic exposure values 
using methods known in the photographic art. If input films of different speeds 
5 are used, the overall red, green, and blue exposures must be properly adjusted for 
each film in order to compensate for the relative speed differences among the 
films. Each film thus receives equivalent exposures, appropriate for its red, green, 
and blue speeds. The imagewise exposed film is chemically processed to produce 
a dye image. Film color patches are read by a transmission scanner which 

10 produces R, G, and B image-bearing signals corresponding to each color patch 
and by a transmission densitometer which produces R f , G', and B' density values 
corresponding to each patch. A transform apparatus creates a transform relating 
the R, G, and B image-bearing signal values for the film's test colors to the 
measured R, G', and B' densities of the corresponding test colors of the reference 

15 color negative film. In another preferred variation, if the reference image 
recording medium was chosen to be a specific color negative film, and the 
intermediary image data metric was chosen to be the predetermined R\ G', and B f 
intermediary densities of step 2 of that reference film, then for an input color 
negative film intended for scanning according to the invention, the R, G, and B 

20 image-bearing signals from a scanner would be transformed to the R r , G', and B ! 
intermediary density values corresponding to those of an image which would have 
been formed by the reference color negative film had it been exposed under the 
same conditions under which the color negative recording material according to 
the invention was exposed. 

25 Thus each input film calibrated according to the present method 

would yield, insofar as possible, identical intermediary data values corresponding 
to the R', G\ and B f code values required to appropriately reproduce the color 
image which would have been formed by the reference color negative film on the 
reference output device. Uncalibrated films may also be used with 

30 transformations derived for similar types of films, and the results would be similar 
to those described. 
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The mathematical operations required to transform R, G, and B 
image-bearing signals to the intermediary data metric of this preferred 
embodiment may include a sequence of matrix operations and 1 -dimensional 
LUTs. Three tables are typically provided for the three input colors. It is 
5 appreciated that such transformations can also be accomplished in other 

embodiments by employing a single mathematical operation or a combination of 
mathematical operations in the computational steps produced by the host 
computer including, but not limited to, matrix algebra, algebraic expressions 
dependent on one or more of the image-bearing signals, and n-dimensional LUTs. 

10 In one embodiment, matrix 1 of step 2 is a 3 x 3 matrix. In a more preferred 

embodiment, matrix 1 of step 2 is a 3 x 10 matrix. In a preferred embodiment, the 
1 -dimensional LUT 3 in step 4 transforms the intermediary image-bearing signals 
according to a color photographic paper characteristic curve, thereby reproducing 
normal color print image tone scale as one form of image look. In another 

15 preferred embodiment, LUT 3 of step 4 transforms the intermediary image- 
bearing signals according to a modified viewing tone scale that is more pleasing, 
such as possessing lower image contrast, as a second form of image look. 

Buhr et aL in U.S. Patent Application Serial No. 09/104,548 
provide a related and even more preferred method of digital photofinishing 

20 comprising the steps of: producing a digital color image in printing or other 
densities of a color image captured on alternative capture photographic media 
(e.g., a color negative film intended for scanning); first mapping the printing or 
other densities of the alternative capture media to the printing densities that would 
have been obtained for reference color photographic media; processing the 

25 mapped digital color image with a scene balance algorithm to produce a processed 
digital color image; second mapping the processed digital color image through a 
hard copy media characteristic curve to produce the mapped digital color image 
mapped to print densities of the hard copy media; sharpening the mapped digital 
color image with a sharpening algorithm optimized to avoid unacceptable 

30 artifacts; and digitally printing the sharpened digital color image onto hard copy 
media. Information accompanying the captured original scene parameters that 
describes the camera parameters responsible for capturing the scene can provide 
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useful input for the signal processing algorithms. Useful information includes any 
single input or any combination of inputs which includes scene illumination type, 
flash parameters such as flash output and/or whether the flash was directed at the 
subject or bounced onto the subject and/or whether sufficient flash power was 
5 available to properly illuminate the subject, camera lens f-stop, camera exposure 
time, and scene orientation. Further features in scene balance algorithms useful in 
the practice of the invention can include mixed illuminant detection and subject 
detection. 

Thus, the scanner densities, the printing densities, or other film 

10 density-representative, image-bearing signals of the input scan film are 

transformed to image printing instructions or image display instructions based on 
the properties of a reference film. The reference film can be an existing film 
intended for the required output operation, or it can be another kind of film 
intended for a different imaging application if appropriate modifications are added 

15 to the image processing chain to account for the current application. It is 

preferred, in one embodiment of the invention, to transform the image-bearing 
signals of the scan film to known output printing or display instructions for 
existing color negative films. In this manner, the output derived from a scan film 
is simply predicted and conveniently image-processed. For example, the scanner 

20 densities or the printing densities from the imagewise-exposed and processed scan 
film can be transformed to the printing densities of a plurality of existing color 
negative films and then written to an output medium such as silver halide color 
paper. The scan film printing densities can be transformed to the printing 
densities of one or more of the following representative example films to satisfy 

25 the requirements of the invention, including, but not limited to: KODAK ROYAL 
GOLD™ films, KODAK GOLD MAX™ films, KODAK GOLD™ films, 
KODAK MAX™ films, KODAK SUPRA™ films, KODAK VERICOLOR™ 
films, KODAK PORTRA™ films, KODAK PRO GOLD™ films, KODAK 
FUNTIME™, KODAK VR™ films, KODAK EKTAPRESS PLUS™ films, 

30 EASTMAN EXR™ films, and KODAK ADVANTiX™ films. Alternatively, the 
scan film printing densities can be transformed to those of any other selected 
reference image capture device or medium, as described in U.S. Patent No. 
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5,267,030 to Giorgianni et al. In a preferred embodiment, the reference image 
capture device is a digital still camera, more preferably one with spectral 
sensitivities that approximate the color matching functions or the human visual 
system. 

5 In the general cases previously described, image recording media 

and devices, and scanning devices, will not directly record the scene parameters in 
the way human observers perceive them. However, all of these media and devices 
can be characterized by a spectral response function, by a function that maps 
scene intensity ratios to device code values and by a multi-dimensional function or 

10 matrix that characterizes the interdependence or cross talk between the at least 
three color channels. Therefore, obtaining the original scene parameters directly 
relating to the light levels of the scene (i.e., scene space exposures) involves 
applying transformations that are the inverses of these functions. It is desirable to 
make the captured scene parameters independent of the particular input device 

1 5 and/or medium and to make the resulting pixel values represent accurate estimates 
of the scene colorimetry. Scene colorimetry is a preferred intermediary data 
encoding metric, since a very wide variety of desirable image appearances can be 
derived by the proper manipulation of the image-bearing electronic signals. A 
most preferred method of providing scene exposures is described in U.S. Patent 

20 No. 5,267,030 to Giorgianni et al., wherein a digital image that was created by 
scanning a film is transformed into a device-independent color space by a 
mathematical transformation. A data set from which the mathematical 
transformation can be derived is produced by exposing a sample of the film with a 
pattern of approximately 400 test color stimuli, chosen to adequately sample and 

25 cover the useful exposure range of the film. Red, green and blue (R, G, B) 
trichromatic exposures for a reference colorimetric image-capturing device or 
medium are then computed for the test stimuli, using standard colorimetric 
computational methods. The imagewise exposed film is chemically processed 
producing a dye image, and the color patches are read by a transmission scanner, 

30 which produces R, G, and B image-bearing signals corresponding to each color 
patch. A transformation is then created relating the R, G, and B image-bearing 
signal values for the film's test colors to the known R, G, and B trichromatic 
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exposures of the corresponding test colors. This transformation is then used to 
convert digital image values that were produced by scanning a film of the type 
that was used to generate the transform using the following procedures: 

1) converting the R, G ? B image-bearing signals, which correspond to the 
5 measured transmittances of the input film, to R, G, and B densities by using 

appropriate 1 -dimensional look-up-tables (LUTs); 

2) adjusting the R, G, and B density-representative signals of step 1 by 
using a 3 x 3 matrix, to correct for differences among scanners in systems where 
multiple input scanners are used; 

10 3) adjusting the R, G, and B density-representative signals of step 2 by 

using another matrix operation or 3-dimensional LUT, to remove the chromatic 
interdependence (i.e., cross talk) of the image-bearing signals produced by any 
unwanted absorptions of the imaging dyes and chemical interlayer interimage 
interactions in the input photographic recording medium, to produce channel 

15 independent, density-representative signals; 

4) individually transforming the R, G, and B density-representative signals 
of step 3 through appropriate 1-dimensional LUTS, derived such that the neutral 
scale densities of the input film are transformed to the neutral scale linear 
exposure-representative signals of that film; and 

20 5) further transforming the R, G, and B exposure-representative signals of 

step 4 by another matrix operation to arrive at the R, G, B scene exposure- 
representative signals corresponding to those which a reference image-capturing 
device or medium would have received if it had recorded the same original scene 
(i.e., scene space colorimetry). 

25 Test color patch sets having fewer than 400 colors can be 

employed to enable more efficient generation of the transformation matrices and 
LUTs and improved use of computational resources. In some embodiments, the 
mathematical operations represented by sequential application of individual 
matrices and LUTs can be numerically concatenated to afford improved 

30 computational speed and to reduce the necessary computational power. 

Analogous procedures can be employed to generate transformation matrices and 



LUTs appropriate for use with the other photographic or electronic image capture, 
image acquisition, and image processing paths described herein. 

It will be appreciated that the scene space exposures determined in 
the aforementioned manner are limited in accuracy by the accuracy of the spectral 
5 sensitivities of the photographic recording medium or device whose input 
recorded image data was transformed. Hence, the earlier noted preference for 
colorimetric capture to the practice of the invention, in order to provide the 
broadest range of useful image reproduction appearances. 

Instead of direct capture of the original scene parameters, it is also 

10 possible to access a representation of the original scene parameters, captured and 
stored at some prior time. These representations may be two-dimensional or 
three-dimensional and may be of still or moving scenes. The only requirement for 
this means of generating a preferred viewed reproduction of the original scene is 
that the relationship between the original scene parameters and those in the 

1 5 accessed original scene representation be known or that it be possible to make an 
accurate assumption about this relationship. The accessed scene representation 
was at some point captured preferably using the methods described above for 
direct original scene parameter capture. 

It is preferred to encode the scene exposures derived in the above 

20 manner, or by another method, in a device-independent color space for further 
manipulation and for eventual transmission to a device-dependent color space for 
display, printing, transmission, storage and so forth. Device-independent color 
spaces are often based on a system of colorimetry developed by the Commission 
International de l'Eclairage (CIE), and representative examples are CIE XYZ and 

25 CIELAB color spaces. A comprehensive discussion of colorimetry and color 
standards can be found in R. W. G. Hunt, "The Reproduction of Color in 
Photography, Printing and Television, Fifth Edition", Fountain Press, Kingston, 
upon-Thames, England, pp. 136-176 (1995). A specification for its well-known 
color spaces can be found in CIE Publication 15.2-1986, "Colorimetry, Second 

30 Edition", Output device-dependent color spaces can also be used for storage, 
interchange, and manipulation of digital images, but they frequently produce a 
compromise in color storage due to a limited functional range or color gamut that 
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necessitates truncation of the colors or luminance ranges that can be reproduced 
by the system. An example of a suitable, contemporary device-dependent color 
space is sRGB. If a limited gamut color-encoding medium is used, the possible 
loss of recorded scene data may be ameliorated by the use of the method involving 
5 image metadata described in EP-A-0 991 019 (published April 5, 2000) and the 
use of the apparatus described in EP-A-0 991 020 (published April 5, 2000). A 
preferred interchange space comprised of a device-independent color encoding 
specification for the practice of the invention is Profile Connection Space (PCS) 
as defined by the International Color Consortium® (ICC), a group of participating 

10 corporations that has set open specifications for electronic device color 

management. The PCS interface represents color appearances by specifying the 
CIE colorimetry of colors viewed on a reference medium in a reference viewing 
environment. A device profile (often called an ICC profile) is used to relate the 
device-dependent code values of an input or output image data set to the 

1 5 corresponding color encodement scheme values in PCS. ICC has published a 
description of both PCS and device profiles in "File Format for Color Profiles," 
Specification ICC. 1:1998-09, and in "Addendum 2 to Spec. ICC.l: 1998-09," 
Document ICC.lA:1999-04, which are quite readily obtained by downloading 
from the ICC website, wwwxolor.org. However it is preferred to store the 

20 intermediary image-bearing electronic signals representing scene exposures or 
manipulated scene colorimetry in a large-gamut color-encoding scheme suitable 
for image manipulation operations. Preferred input and output color encoding 
schemes and interchange methods are described by K. Spaulding, G. Woolfe, and 
E. Giorgiaiuii mIS&TPICS Conference Proceedings, pp. 155-163 (2000). An 

25 especially preferred device-independent color encoding space described therein is 
termed Extended Reference Input Medium Metric (ERIMM). 

Additional illustrative systems for manipulation of digital signals 
including techniques for maximizing the quality of image records are disclosed by 
U.S. Patent Nos. 4,553,156 to Bayer; 4,591,923 to Urabe et aL; 4,631,578 to 

30 Sasaki et aL; 4,654,722 to Alkofer; 4,670,793 to Yamada et aL; 4,694,342 to 
Klees; 4,962,542 to Klees; 4,805,031 to Powell; 4,829,370 to Mayne et aL; 
4,839,721 to Abdulwahab; 4,841,361 to Matsunawa et aL; 4,937,662 to 




Matsunawa et al; 4,891,713 to Mizukoshi et al.; 4,912,569 to Petilli; 4,920,501 to 
Sullivan et al.; 5,070,413 to Sullivan et al.; 4,929,979 to Kimoto et al.; 4,972,256 
to Hirosawa et al.; 4,977,521 to Kaplan et al; 4,979,027 to Sakai et al.; 5,003,494 
to Ng; 5,008,950 to Katayama et al; 5,065,255 to Kimura et al.; 5,051,842 to 
5 Osamu et al.; 5,012,333 to Lee et al; 5,107,346 to Bowers et al.; 5,105,266 to 
Telle; 5,105,469 to MacDonald et al.; 5,081,692 to Kwon et al.; and 5,579,132 to 
Takahashi et al. 

It is appreciated by those skilled in the art that scene colorimetry 
does not produce a pleasing image when directly rendered as a reproduction, such 

10 as a color print. Furthermore, in order to achieve the objectives of the invention, it 
is necessary to manipulate the encoded scene exposures or scene colorimetry, or 
other form of image data, in a plurality of ways in order to allow a selection and 
provision of at least two or more looks. Individuals differ in their preference for 
appearance characteristics of image reproductions. An image "look" can be 

1 5 defined by characterizing the appearance of the reproduction relative to the 
appearance of the original scene. For example, the reproduction tone scale 
quantifies the mapping of the tones in the original scene to the tones in the 
reproduction. A three-dimensional color space mapping can be used to quantify 
the modification of the hues, saturations, and lightnesses of the colors in the 

20 original scene necessary to produce the image reproduction of the scene. 

Additional global characteristics of the reproduction that define the look include 
sharpness and graininess, pertaining to image spatial frequency reproduction and 
noise content, respectively. In addition to global image characteristics, object- or 
region-specific image adjustments may be made to produce the desired "look". 

25 An example of an object-specific adjustment is to transform all non-skintones into 
B&W tones. An example of a region-specific image adjustment is to darken the 
edges of an image to produce a vignetting effect. 

It is well understood by those skilled in the art that image 
colorimetry can be purposefully manipulated in a variety of ways to achieve 

30 changes in image luminance, chroma, and hue, which then can be rendered in the 
image reproduction by means of subsequent well-known transformations. In this 
manner, the scene can be reproduced with higher or lower contrast and brightness 



(which equates to higher or lower scene luminance reproduction (i.e., lightness)), 
with higher or lower colorfulness (i.e., chroma), and with more accurate or less 
accurate color shades (i.e., hue). It is the aggregate of the specific hue 
reproduction, chroma reproduction, lightness reproduction or rendering contrast 
5 (tonal reproduction) in a particular pictorial reproduction that defines a 

distinguishable image look. A highly preferred method for transforming the 
intermediary image-bearing electronic signals representing scene exposures is by 
colorimetric manipulations that can take the form of consistently and smoothly 
shifting colors within a region of color space, so as to deliver an image that 

10 incorporates the look selected by a customer or a photo finisher, which is disclosed 
in U. S. Patent Application No. 09/506,712, to Buhr et al. filed on February 18, 
2000, entitled 'Color Reproduction of Scenes with Preferential Color Mapping', 
and in U. S. Patent Application No. 09/540,807 filed March 31, 2000, to Woolfe 
et al entitled 'A Color Transform Method for the Mapping of Colors in the 

15 Images'. 

By using the above methods of image processing taught by Buhr et 
al. and Woolfe et al. in the aforementioned references, the image-bearing 
electronic signals representing the captured scene can be purposefully 
manipulated by a photofinisher to achieve a very wide variety of visual 

20 reproductions. Thus it is possible to make the pictorial reproduction more or less 
colorful, or to remove color entirely and reproduce color image data as a black- 
and-white reproduction. The method of Buhr et al. allows specific colors to be 
manipulated with minimal or no effect at all on other colors in the reproduction. 
The chroma of green relating to grass and blue relating to sky can be increased, 

25 while the chroma, hue and lightness of skin colors can remain unaffected. Such 
discretion in color reproduction manipulation is beyond the capability of the 
conventional optical print system, which relies on film chemical interlayer 
interimage effects to produce system wide color correction and color 
management. A variety of tonal mappings can be applied, to manipulate visual 

30 reproduction contrast in ways also not feasible in the optical print system. 

Specific colors hues can be shifted, for example by adding blue to the green of 
foliage to produce a more pleasing color reproduction. It is preferred to render 
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mid-tone neutrals with lower contrast than normally used in the color negative 
optical print system, especially with high-key scenes. It is preferred to increase 
the chroma of highly saturated scene colors in the reproduction without affecting 
skin colors, and without resorting to overall high contrast. It is preferred to 
5 smoothly and consistently shift the hue of foliage colors by a desirable hue angle 
rotation. 



tone scale has to be applied to map the relative luminance values of scene colors 
to relative luminance values of the reproduced colors. It is well known to those 

10 skilled in the art that this is rarely a one-to-one mapping. The selection of a tone 
scale that produces the most preferred images depends on a variety of factors, 
including the discrepancy between viewing conditions of the scene and the 
reproduction, anticipated subject matter (e.g., portrait photography, nature 
photography, landscape photography, candid shots, etc.), the dynamic range of the 

1 5 scene in relation to the dynamic range that can be reproduced, and viewer 
preferences. 



combination with hue and chroma manipulations, are disclosed in U.S. Patent 
Nos. 5,300,381 to Buhr et al; 5,447,81 1 to Buhr et al; and in the previously cited 

20 5,528,339 to Buhr et al. However, the invention is not limited to these tone scales 
which are characterized by a linear relationship between scene lightness and 
lightness as perceived by the viewer. Traditional S-shaped tone scales, which are 
mostly used in conventional silver halide photography, produce preferred images 
within the framework of this invention compared with optical printing systems, 

25 because of the large improvements in hue reproduction possible following 

purposeful manipulation of scene exposure data derived in the manner of U.S. 
Patent No. 5,267,030 in an appropriate color space prior to outputting. It is more 
preferred to adopt a rendering contrast with reduced gradient in the important 
midscale densities corresponding to flesh colors compared with the usual tonal 

30 mapping of optical print-through systems to color paper. When adjusting the 
contrast of an image in the form of electronic signals, it is preferred to preserve 



In addition to the hue and chroma manipulations listed above, a 



A family of tone scales that produce preferred reproductions in 



image detail by the application of spatial filtering as described in EP-A-0 971 3 14 
(published January 12, 2000). 

The best results are obtained if a particular tone scale, or a family 
of tone scales, is combined with a classification algorithm that selects the most 
5 appropriate tone scale according to the dynamic range of the scene or if a dynamic 
range adjustment is applied prior to tone scaling. Successful classification 
algorithms will take many forms, including but not limited to histograms, ranges, 
parameters based on the distribution, or transformations of the distribution of all 
or a subset of the recorded or transformed image pixel values. In digital imaging 

10 printing systems, classification algorithms can be implemented to select slightly 
different tone mappings to create the most preferred images. The input for the 
classification can be scene parameters or capture conditions. Information 
accompanying the captured original scene parameters that describes the camera 
parameters responsible for capturing the scene can provide useful input for the 

15 signal processing algorithms. Useful information includes any single instance of 
or any combination of scene illumination type, flash parameters such as flash 
output and/or whether the flash was directed at the subject or bounced onto the 
subject and/or whether the sufficient flash power was available to properly 
illuminate the subject, camera lens f-stop, camera exposure time, scene orientation 

20 and zoom lens status. Such classification algorithms are also useful in automating 
the selection of optimal image looks by a photofinisher to provide to a customer in 
an automated method of photofinishing, in another aspect of the invention. In 
combination with the hue and chroma manipulations, lightness manipulations can 
take any of the following forms: applying a scene-dependent tone scale 

25 transformation, applying a global scene-independent tone scale transformation, or 
applying a global scene-dependent or scene-independent tone scale 
transformation. In one aspect, the invention is directed at providing a selection of 
image looks suitable for viewing a scene reproduction in a variety of viewing 
illumination environments. A method for producing color-appearance matching 

30 for an image viewed in different surround conditions by the application of 
appropriate image luminance contrast factors is described by U.S. Patent No. 
6,046,723 to Daniels et aL 
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A preferred method of implementing the image processing method 
of Giorgianni et al, in U.S. Patent No. 5,267 3 030 and Buhr et al. in U. S. Patent 
Application No. 09/506,712, to provide multiple image reproduction appearances 
is shown in Fig. 7. In step 701, a film intended for scanning is scanned producing 
5 image-bearing electronic signals R, G, and B, preferably in the form of scanner 
densities. An ICC profile is used to convert the density-representative signals into 
scene space exposure-representative signals encoded in a suitable colorimetric 
space R f , G', and B' ? in step 702. As described previously, ICC has published a 
description of both PCS and ICC device profiles in "File Format for Color 

10 Profiles," Specification ICC.l: 1998-09, and in "Addendum 2 to Spec. 

ICC. 1 : 1998-09," Document ICC. 1 A: 1999-04. The exposure-representative 
signals are adjusted for color bias and intensity using a scene balance algorithm in 
step 703. An ICC profile transforms the balanced exposure-representative signals 
R', G', and B' into the device-independent colorimetric encoding specification of 

15 (PCS) R", G'\ and B" in step 704. It is convenient to provide a plurality of 
different image looks by applying a plurality of different ICC profiles in PCS 
space. In step 705, modified PCS space image-representative signals with the 
intended properties of the selected image look are produced by the application of 
the appropriate ICC profile from an available group of look-application profiles. 

20 It is preferred that the PCS space image-bearing signals R", G", and B" produced 
in step 704 are an accurate color or colorimetric representation of the 
photographed scene rather than a colorimetrically inaccurate, more viewer- 
preferred representation. Increased simplicity in managing an inventory of 
appearance profiles is afforded by basing individual appearance profiles on 

25 changes to output scene colorimetry, which is unchanging; thus image look 

profiles can be added and removed from the digital photofinishing system with 
minimum inconvenience. In step 706, an ICC profile transforms the image- 
bearing electronic signals of PCS color interchange space into device-dependent 
code values with the applied image look R'", G "', and B'" appropriate for 

30 printing or other end uses as determined by the output profile selection. 



Thus, for the provision of a plurality of looks to a customer by a 
photofinisher, either of the two previously described methods is suitable to 
produce differentiable image appearances in the output image files: (1) the method 
of Buhr in U.S, Patent Application Serial No. 09/104,548 involving the use of 
5 printing density transformations wherein scanning and image processing spectral 
responsivities match those of a particular optical photographic printer and 
photographic output medium (e.g., densitometric encoding); or (2) the method of 
Giorgianni in U.S. Patent No. 5,267,030, wherein density-representative signals 
are rendered channel independent and converted to scene exposure-representative 

10 signals prior to colorimetric manipulation of hue, chroma, and lightness (e,g., 

colorimetric encoding). One of the two image processing methods and means can 
be used separately to provide all of the image looks, or the methods may be used 
jointly, each method providing one or more of the output looks, preferably from a 
single acquisition of data by scanning the input medium, to provide the 

15 multiplicity of image looks. It is preferred to use the method of the 5,267,030 
patent to produce scene space exposure-representative electronic signals to 
provide at least one of the looks. It will be appreciated that the methods of 
providing image looks are not limited to the procedures described in f 030 of 
Giorgianni et al. or in '548 of Buhr et al., but any suitable method of image 

20 processing that provides differentiable visual reproductions can be used in the 
invention. 

It is within the scope of the invention to provide two differentiable 
looks for a film intended for scanning. It is preferred to provide at least three 
image looks. It is most preferred to provide up to five image looks, but there is no 

25 limit on the number of looks that can be offered. An especially preferred 

combination of looks is a black-and-white rendition, a portraiture rendition (e.g., 
lower chroma, lower contrast, and lower sharpness), a general or basic default 
rendition (e.g., high chroma, intermediate contrast, high sharpness), and a high 
colorfulness rendition (e.g., very high chroma, high contrast, and high sharpness). 

30 It is preferred for the photofinisher to impart color and tone rendition properties 
that are unavailable through the usual optical print system in at least one of looks 
in order to provide visually superior digital output. It is more preferred for the 
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photo finisher to provide at least two preferred color and tone looks, neither of 
which are produced by direct printing density transformations or by the optical 
print system. Altering the image spatial signal processing, for example to increase 
sharpness (e.g., for a landscape), or to decrease sharpness (e.g., for a portrait), 
5 constitutes a differentiable image look according to the invention even if the color 
and tone reproduction properties are otherwise unaltered. Color image 
reproductions can be supplemented with black-and-white reproductions as 
differentiable looks, with monochrome reproductions, with simulations of 
historical prints hues such as sepia or brown-toned, or other unnatural 

10 reproductions of the captured scene. In another aspect of the invention, 

cartoonization can constitute one or more of the provided looks. Cartoonization 
can be made to render the input image to appear like a child's coloring book 
images, like impressionistic oil paint images, like rasterized color images, like 
quantized digital color images showing contouring effects, like sidewalk chalk 

1 5 pastel images and so forth. In addition to color manipulation, texture (e.g., 

patterns) can be applied to the image as well. Of course, captions, labels, dates, 
text boxes, and other kinds of information can be attached to the image data or the 
output reproduction in printed or other form. 

The last step in Fig. 1 is to produce a visual reproduction of the 

20 image in step 108 or to transmit a modified image file to a recipient in step 109 
that was processed according to the specifications in steps 106-107. The image 
can be reproduced on any transparent or reflective material (hard copy) or on a 
self-luminous display (soft copy) that produces images by additively mixing at 
least three suitably chosen primary colors or by subtractively mixing at least three 

25 suitably chosen dyes. 

A digital, electronic representation of the manipulated image is 
transformed into an analog signal of the correct intensity and spectral distribution 
in order to generate the desired visual reproduction of the manipulated image. 
Reproduced images may be displayed in two- or three-dimensional form. 

30 Examples of this procedure include the display of an image on a color monitor or 
an electronic printing process whereby a color photographic paper receives an 
image-wise exposure by a CRT or laser printing device and the material is 
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subsequently chemically processed, for example by KODAK EKTACOLOR™ 
RA-4 Process, to produce a reflection print. 

The electronic signals representing the selected image reproduction 
resulting from applying steps 104-107 of Fig. 1 must be transformed into a 
5 corresponding set of device code values to account for the scene parameter 
manipulation characteristics of the output device and media in step 108. The 
transformation between device code values and the colorimetry of the colors 
reproduced by a particular device/media combination can be obtained by a device 
characterization. An example of a device characterization is a procedure that 

10 involves generating and printing or displaying a suitable array of device code 
values in the form of color patches of a size large enough for subsequent 
measurement. These patches can be measured using a colorimeter, a 
spectrophotometer or a telespectroradiometer, depending on the nature of the 
output, such as for example, a silver halide color paper reflection print, or an 

1 5 inkjet reflection print. If monitor display output spectra are measured, CIE XYZ 
tristimulus values and other related quantities such as CIELAB or CIELUV color 
space coordinates can be calculated for the display illuminant using standard 
colorimetric procedures. This data set can be used to construct the appropriate 
sequence of one-dimensional look-up tables, multidimensional look-up tables, 

20 matrices, polynomials and scalars that accomplish that transformation of the 
image-bearing electronic signals derived from step 107 of Fig. 1 into a set of 
device code values that produces the desired visual reproduction of the scene. A 
preferred example of the implementation of this transformation is an ICC-type 
profile that maps the specifications of the desired visual reproduction^ encoded in 

25 a color interchange space such as PCS, to device code values, the actual machine 
printing or monitor display instructions. 

This operation may also include gamut mapping. The color gamut 
of the scene representation at the end of step 107 of Fig. 1 is determined by the set 
of primaries that was used for encoding the data. Examples include the primaries 

30 corresponding to the color-matching functions of the CIE 1931 Standard 

Colorimetric Observer or any linear combinations thereof. Gamut mapping is 
performed between the gamut defined by this encoding and the gamut of the 
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combination of the output device and the output media, in the case of a reflection 
print. It is preferred to use gamut-mapping algorithms that maintain color hue, in 
practice of the invention. 

The image data transformation of step 108 can be combined with 
any of the transformations in step 107 to form a single set of one-dimensional 
look-up tables, multidimensional look-up tables, matrices, polynomials and 
scalars in any sequence. Reproductions according to the specifications of the 
invention can be produced by a variety of technologies. Reproductions can be 
obtained on silver halide or other light-sensitive materials. The light-sensitive 
material can be transparent film, reflection print paper, or semi-transparent film. 
These materials are exposed by visible or infrared light derived from many 
different sources. The materials may be designed for typical photofmishing 
applications or they may be specially designed for digital printing applications. 
The photosensitive materials respond primarily to three different spectral regions 
of incident light. Typically, these are red (600-720 nm), green (500-600 nm), and 
blue (400-500 nm) light. However, any combination of three different spectral 
sensitivities can be used. These could include green, red, and infrared light or red, 
infrared 1, and infrared 2 light, or 3 infrared lights of different wavelengths. Or a 
material sensitive to the three primary wavelengths of visible light may be false 
sensitized so that the color of the exposing light does not produce image dye of 
the complementary hue, such as red, green, and blue sensitivity producing 
magenta, yellow, and cyan dye, respectively. Printing can be carried out by 
exposing all pixels sequentially, by exposing a small array of pixels at the same 
time, or by exposing all the pixels in the image at the same time. 

Devices, which can be used to print on light-sensitive materials, 
include CRT, light emitting diode (LED), light valve technology (LVT), LCD, 
laser, as well as any other controlled optical light generating device. All these 
devices have the ability to expose 3 or more light-sensitive layers in a light- 
sensitive material to produce a colored image. They differ mainly in the 
technology on which the devices are based. A suitable embodiment of a CRT 
printer is the KODAK PROFESSIONAL Digital Multiprinter, which can be used 
in combination with KODAK PROFESSIONAL Digital III Color Paper. 
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Non-light-sensitive imaging materials are conveniently used by 
electronic printing processes to produce high-quality reproductions. The method 
of image formation can be half-tone, continuous tone, or complete material 
transfer. The image reproduction material can be transparent film, reflective 
5 paper, or semi-transparent film. The media can be written on to produce pictorial 
images by thermal dye transfer, inkjet, wax, electrophotographic, or other 
pixelwise writing techniques. These processes use three or more colorants to 
create colored pictorial representations of pictorial scenes. The colorants may be 
dyes, toner, inks, or any other permanent or semi-permanent colored material. A 
1 0 suitable example of a dye transfer thermal printer is the KODAK 

PROFESSIONAL XLS 8650R Thermal Printer. Both non-impact and impact 
printing methods, such as traditional press methods, are specifically contemplated. 

In addition to hard copy viewed images, it is also possible to create 
projected images, which have the differentiable image looks in accordance with 
1 5 the invention. Many technologies are appropriate for this kind of image 

generation. All these techniques rely on producing color images with two or more 
colored lights. These are typically red, green, and blue in nature although they 
can be any set of primaries. Devices, which can be used to create the preferred 
viewed reproduction, include CRT, LCD, electro-luminescence (EL), LED, 
20 OLED, light bulbs, lasers, plasma display panels, or any other three or more 

colored lighting apparatus capable of pixel wise illumination. The images can be 
created by display within the device, projection, or backlighting. Many devices 
create an image on a screen or display area, which is physically a part of the 
mechanical unit. However, images can also be created by optically projecting the 
25 image in the form of light rays from behind or in front of the viewer toward a 

screen, which is in front of a viewer, or by projecting a reversed image toward the 
viewer onto a screen between the viewer and the projecting device. 

It is within the scope of the invention to transmit processed image- 
bearing signals to an intended recipient as in step 109 of Fig. 1 in accordance with 
30 steps 101-107 to enable digital motion imaging projection. A motion imaging 
data file (e.g., a digital electronic movie) can be constructed by scene capture and 
reproduction from a film intended for scanning with multiple characteristic 



appearances applied on a frame-by-frame or on a scene-by-scene basis to create 
associated multiple preferred scene reproductions suitable for broadcast and wide- 
format display as in a movie theater or home display, as on a television set. 

Image data storage can be accomplished in a variety of ways, 
including magnetic, optical, magneto-optical, RAM, biological, solid state, or 
other materials, which permanently or semi-permanently record information in a 
retrievable manner. Examples of suitable storage media and devices include 
computer hard drives, floppy disks, writeable optical disks such as KODAK 
PHOTO CD™ Discs, KODAK PICTURE CD Discs, KODAK Picture Disk 
Media, and flash EEPROM (Erasable Electrically Programmable Read-only 
Memory) PCMCIA cards. Image data transmission can be accomplished most 
effectively by high throughput means including the use of optical and 
electromagnetic transmission technologies. 

The following concrete examples are provided for illustrative 
purposes, and are not to be intended to be limiting in any way. 

In a first example, a customer purchases a package comprised of 
color photographic film intended for scanning and a processing mailer envelope 
for directed photofmishing from a retail photospecialty shop. The packaging 
indicates that the photofmishing service provides a selection of available image 
appearances, and sample images with exaggerated differences and with 
descriptive labels appear on the packaging. The mailer envelope has check-off 
boxes associated with the descriptive names for the different appearance 
selections, and the usual customer identification, billing, and shipping information 
inputs (see. Figs. 2A and 2B). After exposing the roll of film intended for 
scanning, the customer ships the film to the photofmisher in the mailer envelope 
with two image looks selected and two prints per image frame requested, each 
with a different print look, for his whole roll order of processed images. One of 
the selected looks for one set of prints is the service basic look, which features 
high colorfulness that is intermediate in a range of offerings, preferred color 
rendition based on the North American region, and a lower contrast tone scale; the 
second look to be applied to the second set of prints is the automated photofmisher 
selection, based on best image rendition determined by scene categorization 
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algorithm software. The photofinisher receives the film, establishes a customer 
account, tags the film intended for scanning with a customer identification 
number, develops the film intended for scanning, scans the film intended for 
scanning, and then applies each of the two different image appearances requested 
5 by the customer to each frame of scanned image data for the entire processed roll 
of color negative film. The processed images are printed onto silver halide color 
paper with a CRT printer, the color paper is processed, finished and packaged for 
shipping with the processed color negatives of the film intended for scanning. 
The photofinisher ships the order of two sets of different color paper prints to the 
10 customer. 



Web site for a photo specialty retailer/photofmisher, and orders a supply of film 
intended for scanning and their processing mailers, which is shipped to his home 
via a parcel delivery service after a credit card transaction has been completed. 

15 While at the Web site, the customer takes the tour of the variable printing 

photofinishing service offered by the vendor. In a tutorial screen, the vendor 
highlights the offering of various printing styles, which can be applied to the 
customer's image, including true color, high color, portrait color, landscape 
rendering, basic color rendering with digitally enabled color reproduction 

20 preferences , and black-and-white (see, for example, Fig. 10). The customer 
samples the photofinishing service interactively, by selecting an image from a 
sample customer roll displayed like an index print on the Web screen, by taking 
that selected image to a customization screen where he can select four of the 
available looks to apply to the sample image, and by displaying three side-by side 

25 renditions of the sample image with the selected printing styles (see Fig. 10). 



includes interactively selecting pictures and styles to print following film 
development. The customer exposes the roll of film intended for scanning, 
completes the photofinishing mailer electing to try the interactive picture selection 
30 service, and he mails the mailer with the contained film. The mailer is received 
by a local photofinishing service, and a customer account is created to bill the 
transaction; a customer identification number is associated with the roll of film, 



In a second example, a customer visits an Internet World Wide 



The customer then views his output printing options, which 



and the film is developed and scanned. The customer is notified by e-mail that his 
film has been scanned. The customer again visits the Web page of the 
photofmishing service and provides a password that admits him to another page in 
a secure section of the network, which contains an index display of all of the 
images from his roll. 

The customer then selects five of the 15 available images for 
printing, and examines each of the five desired images at the customization Web 
page, where he determines which printing style is his preference for each image. 
Those five images are printed by the photofinisher using an inkjet printer 
according to the customer selection, and the prints are packaged. Image data files 
are created of the five images selected for printing with the printing style selected 
by the customer; image data files of all 15 available images rendered in the normal 
printing style are also created. All 20 image data files are written to a 
photographic image CD in a commonly accessible image data file format; the 
image file construction with metadata encoding allows the photofinisher to 
recreate the basic customer image data file from modest file sizes produced by 
data compression as needed for further image processing and to apply any of the 
available looks at the customer's request at a later date. The image prints that 
were printed according to the selection of the customer and the photographic 
image CD are packaged together and shipped to the customer. The processed 
color negatives derived from the film intended for scanning are not returned to the 
customer by his selection of that option. In addition, at the time of the creation of 
image data files, downloadable compressed image data files are made available on 
the server that the customer can access in order to download his image files prior 
to the arrival of the package of prints and the photographic image CD. 

Before receiving his prints and the CD, the customer decides he 
would like two additional prints of images he elected not to print following initial 
development and printing. The customer revisits the photofinisher Web page, 
enters the secure customer image storage area and visits the Web page displaying 
his index image file set. The customer selects those two images, selects new looks 
to be applied to the two images, and he creates a new printing order transaction 
and billing cycle. The customer also downloads an image file from the Web page 
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in order to send an e-mail message with an attachment of the image to another 
party. The customer arranges the seven images with his selected looks in an 
electronic photo album Web page that is part of the image network offer by the 
photofmisher; he then annotates the Web page via PC telephony with comments 
5 and captions. The customer transmits the password associated with that secure 
Web page to a relative via e-mail to invite their viewing of his photography and 
his artistic creation. 

Figs. 8-1 1 illustrate further features of the photofmishing method 
and system of the present invention. In a first arrangement, it is possible for a 
10 photofmishing service provider (i.e., a wholesale photofmishing lab, a minilab, a 
retail store, an online service provider, etc.) to identify customer preferences 
utilizing an interactive "look preference" identification screen by way of their 
home computer or a computer at a retail location. More specifically, a 
photofmishing service provider can track previous customer selections as to 
15 picture "look" and return the customer to that "look" at the next interaction. 

Thereafter, the photofmishing service provider can customize the next selection 
screen based on past preferences. The photofmishing service provider can also 
track "look" preferences through total order fulfillment. 

In the system as illustrated in Fig. 8, when a customer opens up an 
20 interactive session via, for example, his/her home computer, and connects with the 
photofmishing service provider via, for example, the World Wide Web, the 
photofmishing service provider can offer various looks to the customer at the 
interactive screen and record the customer's selection. During the interactive 
session, the photofmishing service provider can also return previously chosen 
25 looks to the customer at the screen and tie a unique film identification (ID) to the 
customer's preferred look based on the interactive screen. Thereafter, the 
photofmishing service provider can provide digital processing derived by, for 
example, scanning and/or digitization of exposed and photographically developed 
film according to the preferred look at the interactive screen. 
30 More specifically, in the system and method of the first 

arrangement, the customer would first open an interactive ordering session (step 
802). After the customer opens the ordering session, and connects with a 
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photofmishing service provider, the photofmishing service provider can capture 
the customer ID (step 804) via, for example, the logon ID 902 / password 904 
entered at the customer's web access device as illustrated in Fig. 9. As a further 
option, the photofinishing service provider can offer an ancillary ID/password 
5 reminder function 906 using well-known techniques. New users can be 

automatically directed 908 towards tutorial screens relating to the screens shown 
earlier as Figs. 3 through 4B that will describe the photofmishing service 
offerings. Known users who directly reach service entry points such as those 
shown in Figs. 3 - 4B can also be provided with the pre-built preference profiles 

10 to be described below. The photofinishing service provider thereafter provides the 
customer ID to a server and checks for the existence of a customer profile on this 
server in a file that is identified by the customer ID (step 806). If the customer 
does not have a profile, then the system proceeds with step 808 that commences 
the building of a preference profile that is unique to the customer. 

15 In building the profile, the photofinishing service provider can pass 

a generic order screen to the customer's web access device. Thereafter, the 
photofinishing service provider can capture customer order characteristics, such as 
for example, items, quantity, payment method, delivery method, etc., and 
preferred picture look preferences (like that shown earlier as Figs. 3 - 4B). 

20 Possible picture look preference choices vary according to criteria such as 

colorfiilness or color intensity (black and white to high color); color shading or 
hue; contrast (low to high); or low to high detail (softer portrait look to every- 
small-feature-shows look). Further look preferences can include most accurate 
color style, portrait style (muted color, best skin tones), brilliant color style 

25 (highly saturated colors, postcard look), historic sepia style, black and white style, 
etc. 

One embodiment of the first arrangement discussed above is 
illustrated in Fig. 10. Here the choices are presented as multiple renditions 1004 
of a single scene on one screen 1002 with the renditions varying along the named 
30 criteria discussed above, and the customer is asked to choose 1006 his/her favorite 
rendition. After three to five screens, each probing a distinct single scene, the 
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customer's average look/preference choice can be identified and a profile 

developed accordingly. 

In a further embodiment of the first arrangement, a single scene can 
be shown to the customer on a screen and the customer can be asked to mouse- 
position a set of on screen sliders (or radio buttons) to bring the scene to his/her 
favorite look. After three to five screens, each probing a single scene, the 
customer's average look/preference choice can be identified and a profile 
established. In a still further embodiment of the first arrangement, a customer can 
choose to defer his/her look/preference until the return of the exposed film. 

After the profile is built, product preparation directions which 
follow the customer's order characteristics and the customer's average 
look/preference can be provided along with payment and delivery directions to the 
server, and these directions can be passed to an order fulfillment service/function 
station (step 810), following generally the scheme illustrated in Figs. 2 - 4. 
Thereafter, the look/preference choices and the directions can be stored (step 812) 
in a new file which is identified by the customer ID and a date stamp. 

The building of a preference profile is schematically illustrated in 
greater detail in Fig, 11. Here, the selected interrogatory scenes are sequentially 
passed to the customer, steps 1102, 1106, 1110 and 1114, and the customer's 
rendition preferences for the individual scenes are recorded, steps 1 104, 1 108, 
1 1 12 and 1116. Based on the tonal and color differences between that preferred 
rendition of each scene and the spectrally and tonally accurate position of each 
scene, the average offset to the accurate spectral and tonal values that best fulfill 
the customer's preferences are determined and recorded at step 1118. The 
selected interrogatory scenes are chosen to span the range of scenes typically 
encountered and can include low and high contrast scenes, scenes with a high 
memory color content, busy scenes, indoor scenes, outdoor scenes and so forth. 
Clearly, a single scene can be used to probe several of these axes. 

In another embodiment, a single scene can be shown on each 
screen and interactive means, such as radio buttons or sliders, can be provided for 
actively altering scene characteristics until a preferred rendition is achieved, and 
the position of the sliders or radio buttons recorded and passed back to the server. 
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In another embodiment, not shown, the customer may be provided 
with a brochure showing various renditions of the interrogatory scenes and 
instructions for first choosing between the scenes and then entering the choices, 
either directly on the brochure or otherwise communicating the selection to the 
photofmishing service provider as for example via an interactive web-page or a 
touch screen at a kiosk. This embodiment can be preferred since it tends to 
suppress artifacts relate to the specific color and tonal characteristics of a 
particular soft copy display. This embodiment can also be preferred when 
communications between the customer's information entry point and the server 
are challenged. 

More generally, when communications between the customer's 
information entry point and the server are facile, the entry point can act primarily 
as a data entry and display device, however, when communications are 
intermittent, slow or otherwise bandwidth restricted, the selection routine can be 
downloaded to the entry point as a free standing application, as for example a 
JAVA applet. 

In yet another embodiment, selections around the customer's own 
scenes, as described in Figs. 4A and 4B can be employed to form the basis for 
determining the average offset required to provide preferred renditions to the 
customer at future sessions. 

If at step 806 (Fig. 8) it is discovered that the customer does have a 
profile in existence, the photofmishing service provider can retrieve the customer's 
preferences from a server file identified by the customer's identification. The 
photofmishing service provider can post all customer order characteristics to the 
customer's web access device, and present one of the previous look/preference 
probing screens pre-set to the customer's last chosen look. As an option, the 
photofmishing service provider can present one of the customer's images from a 
recent order pre-set to the customer's last chosen look. Next, the photofmishing 
service provider can capture the customer order characteristics (such as items, 
quantity, payment method, delivery method, etc) and preferred picture 
look/preferences. As noted above, possible picture look/preference choices vary 
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according to criteria such as color intensity (black and white to high color); 
contrast (low to high); etc. 

In the embodiment which involves building a profile, multiple 
renditions of a single scene on one screen can be presented to the customer, with 
the renditions varying along the name criteria and the customer being asked to 
choose his/her favorite rendition. After three to five screens, each probing a 
single scene, the customer's average look/preference choice can be identified. In 
the further embodiment with a respect to a pre-existing profile, a single scene can 
be shown on a screen and a customer can be asked to mouse/position a set of on- 
screen sliders (or radio buttons) to bring the scene to his/her favorite look. After 
three to five screens, each probing a single scene, the customer's average 
look/preference choice can be identified. 

After the customer's look/preference choices have been selected 
(regardless of whether a profile has been built or a preexisting profile has been 
used), the photofinishing service provider can pass product preparation directions 
following the customer order characteristics and the customer's average 
look/preference along with payment and delivery directions to a server. Further, 
the photofinishing service provider can pass directions to an order fulfillment 
station for fulfilling the customer's specific orders. Thereafter, the photofinishing 
service provider can store the look/preference choices and all directions in a 
customer's file identified by the customer's identification and a date stamp. 

In the first arrangement, noted above (regardless of whether a 
profile has been built or a preexisting profile has been used), after the interactive 
session is closed, the photofinishing service provider can proceed to fulfill the 
film order (order fulfillment function). In doing this, the photofinishing service 
provider can proceed to make arrangements for the execution of payment, and pull 
unexposed film according to the order and the recorded unique film ID. The 
photofinishing service provider can additionally proceed to pull an unused film 
return envelope and endorse the envelope with the unique film identification, the 
customer identification, and customer order preferences and desired 
look/preference. All the endorsements can preferably be made in both human 
readable and machine readable form. If the customer desires to chose 



# - 59 - €> 



look/preference later, the envelope can be endorsed accordingly, and include a 
reminder and illustrative samples to encourage a look/preference choice. The 
photofmishing service provider further associates the unexposed film and the 
unused film return envelope. Thereafter, the photofmishing service provider can 
access the server and customer file and store the unique unexposed film 
identification in that file in association with other specific order characteristics 
(look/preference), and thereafter execute order delivery. 

Once the customer receives the unexposed film, they can expose 
the film accordingly, and return the exposed film to the photofmishing service 
provider. The photofmishing service provider receives the exposed film in an 
endorsed envelope. If the look/preference on the endorsed envelope matches the 
stored look/preference, then the photofmishing service provider proceeds with 
order fulfillment in accordance with the customer's request. If no look/preference 
is indicated in the stored customer file, the customer file is updated with the 
look/preference chosen and also, an indication that the look/preference was 
chosen after order placement. If the look/preference on the envelope does not 
match with the stored look/preference, the customer file is updated with the 
look/preference indicated on the envelope, and an indication is made that the 
look/preference was changed after an initial order placement. 

Thereafter, the photofmishing service provider can proceed to 
process the imagewise exposed film, scan the film ID, scan images, etc. After 
processing, the photofmishing service provider accesses a server and based on the 
film ID, identifies customer specifications as to look/preference, etc. Based on 
this, the photofmishing service provider can prepare prints, etc. according to 
customer specifications including look/preference, and return the prints to the 
customer. Additionally, the photofinishing service provider can add a descriptive 
filler to the returned prints to specifically indicate which look/preference was 
chosen and when it was chosen. 

In a second arrangement of a further feature of the present 
invention, it is possible to create a soft display (monitor) color profile by 
providing selectable test targets and recording the customer's best match judgment 
between the provided target and on screen colors. The test targets can be chosen 
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from provided trade-dress, provided calibration patches or preferred memory. 
Sliders/radio buttons/ring-around can be provided to alter color signals and if an 
accurate color is not possible, the photofmishing service provider can thereafter 
inform the customer. 

In such a system, as in the first arrangement discussed above, the 
customer opens an interactive session. The photofmishing service provider can 
capture the customer ID from a logon ID/password and enter the customer's web 
access device. Otherwise, the photofmishing service provider can offer an 
ancillary ID/password reminder function. During the interactive session, the 
monitor resolution, monitor color depth, monitor color temperature, operating 
system information, video card information of the customer's web access device 
and monitor drive information can be captured using standard browser calls. 

Thereafter, the monitor and system settings of the customer's web 
access device are compared to preferred system settings that provide the best 
calibration results. If the current settings are acceptable, these settings can be 
recorded and stored at a server. If the current settings are not acceptable, the 
customer can be provided with suggested monitor and system settings for best 
results. Further, the photofmishing service provider can request that the customer 
make suggested changes and restart the session if the customer accepts the 
suggested changes. If the customer does not accept the suggested changes, the 
photofmishing service provider can provide the customer with a warning that 
remote calibration may be sub-optimal. 

In the event that the settings are acceptable, as indicated above, the 
settings along with the customer identification can be stored at a server. At this 
point, the photofmishing service provider can check for the existence of a 
customer color profile on the server in the file identified by the customer's ID. If 
no profile is found, the photofmishing service provider can proceed to build a 
customer profile. If a profile exists, the photofmishing service provider can 
utilize the existing profile. 

In building a profile, the photofmishing service provider will pass a 
color calibration tool to the customer's web access device. In one embodiment 
(color matching) the tool can include a sequence of screens, each of which 
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presents a patch of a particular color with a set of variations (ring-around) of hue- 
modified renditions, chroma-modified renditions, and/or lightness-modified 
renditions of that same color. The customer is instructed to pick the best match 
between the screen display and an in-hand standard. The in-hand standard can be 
a set of ID calibration patches previously provided to the customer, or it can be a 
set of ID patches printed in a recent catalogue, or it can be an article having a 
multi-colored trade-dress, etc. 

In a second embodiment (color matching), the tool can be 
presented as a sequence of screens, each of which presents a color patch with a set 
of control-sliders or control-radio buttons which can independently control the R, 
G and B content of the transmitted patch. The customer is thereafter instructed to 
choose the slider combination or radio-button combination that provides the best 
match between the presented patch and the in-hand standard. 

In a third embodiment (memory preferences), the tool can include a 
sequence of screens, each of which presents a memory color (sky, grass, skin, etc.) 
and is labeled with that memory color. The customer is requested to choose 
which color rendition best accommodates his memory preferences. Either a color 
matching protocol or a control method can be employed here. 

In each of the above embodiments, the color calibration tool can be 
controlled remotely from the server or it can be a downloaded tool. As a further 
option, mixed combinations of the first, second and third embodiments can be 
employed. 

Other useful remote color calibration schemes are described by Gu, 
U. S. Patent No. 5,874,988; Daly, et al., U. S. Patent No. 5,754,222; Collette, U. 
S. Patent No. 5,081,529; by W. Benedetti in Photo Electronic Imaging, page 28-ff, 
March 2000; and in the Imation Verifi™ color system. The underlying computer 
instructions to drive all the look optimization schemes described herein can be 
provided remotely, as a free-standing applet run during the optimization or as 
installed software depending on the cost and convenience of communication 
between the customer's data entry point and the photofinisher's server. 

After the above options are presented to the customer, the customer 
employs the chosen color calibration tool to choose the modifications to each 
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provided color patch that provides the best match between his screen output and 
the in-hand color patches. The best-matched customer judgments from above are 
returned to the server and the R, G, B characteristics that compensate for the 
biases of the user's soft display screen are calculated. The color calibration tool 
5 with all color patches modified is passed back to the customer's web access device 
for confirmation by the customer. Further, notice is given that the colors of the 
color calibration tool have been modified to account for the customer's judgment. 
If the customer confirms, then the photofinishing service provider can proceed to 
use the profile, or else use the information to build a profile for an additional pass, 
10 and keep count of the number of passes. After two passes, if the colors are still 
not correct in the customer's judgment, the photofinishing service provider can 
suggest that color calibration is not likely to succeed and record the results. 
Thereafter, all the colors can be reset to a standard valve and the program can be 
closed. 

15 In the event that the customer already has a profile stored, the 

photofinishing service provider can retrieve the customer color preferences from 
the server file identified by the customer identification. The photofinishing 
service provider checks the retrieve monitor and system settings and compares 
them to the monitor and systems settings captured in the current session. If 

20 different, the system can proceed to indicate that the color profile should be rebuilt 
for best results and directs the customer to build a profile. If everything is 
acceptable, the photofinishing service provider program can transmit several test 
colors to the customers access device using the deviations built into the 
customer's profile and ask the customer to confirm transmitted colors. If rejected, 

25 either that color profile should be rebuilt for best results and the customer should 
be directed to build a profile. Otherwise, the color deviations can't be employed 
and embedded in the customer profile to conduct a transaction. At the end of the 
transaction, the color deviations recorded are employed along with the transaction 
data. 

30 It is noted that the methods and systems described can be part of a 

computer program product that includes a computer readable storage medium with 
a computer program stored thereon. When the computer program product is 
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loaded with a computer, it causes the computer to process images and perform 
photofinishing services in the manner described in the present specification. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the spirit and scope of the invention. 



